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ABSTRACT 


N)  This  report  discusses  methods  of  using  heuristically  derived 
representations  of  uncertainty  to  Improve  the  performance  of  military 
command  and  control  systems.  Two  algorithms  are  derived  to  permit  system 
operators  to  define  and  evolve  non-parametrlc  probability  density  functions 
These  algorithms  have  been  instrumented  on  an  interactive  computer-graphics 
system.  This  preliminary  effort  Is  posed  as  an  Initial  step  of  a more 
extended  research  and  development  program,  jv 
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1.0  INTRODUCTION 


This  report  documents  the  results  of  o preliminary  investigation  of 
new  post-detection  target  processing  techniques  applicable  to  command  and 
control  functions  of  swimmer  defense  systems  (SDS).  New  interactive  algorithms 
and  computational  techniques  that  come  under  the  overall  heading  of  heuristic 
information  processing  (HIP)  were  developed  during  the  investigation.  The 
algorithms  developed  can  be  used  for  estimating  and  predicting  target  location. 
They  will  ultimately  comprise  a technique  which  allows  the  system  operator  to 
generate  his  own  target  motion  analysis  solution  or  modify/edit  the  machine- 
derived  solution.  The  output  of  these  algorithms  are  generalized  or  non- 
parametric  probability  density  functions  (NPPDF's)  which  represent  the  target's 
location  uncertainty.  These  PDF's  are  machine-usable  and  would  serve  os  Inputs 
to  the  succeeding  phases  of  SDS  functions  such  as  the  optimal  allocation  of 
sensor  resources  or  computing  a countermeasure  tactic  for  the  neutralization 
subsystem. 

The  remainder  of  Section  1 discusses  some  background  material  relevant 
to  the  investigation  and  formalizes  the  statement  of  the  research  problem. 
Section  2 presents  a quick  overview  of  the  potential  of  heuristic  information 
processing  applied  to  swimmer  defense  and  other  command  and  control  systems. 

In  Section  3 we  describe  the  interactive  NPPDF  algorithms  Instrumented  for 
this  project.  The  description  of  the  interactive,  software  is  found  in  Section 
4.  Sections  5 and  6 discuss  the  results  of  a cursory  engineering  evaluation 
of  these  algorithms  and  includes  some  conclusions  and  recommendations  for 
further  study.  The  Appendices  contain  the  program  listings  and  technical 
materials  which  augment  the  presentation  of  the  algorithms  developed.  Appendix 
D contains  a summary  description  of  an  important  experiment  in  heuristic.  Infor- 
mation processing  performed  at  ISC  as  part  of  the  S270^  program  to  develop  a 
defense  against  combat  swimmers. 


1 , 1 BACKGROUND 


It  is  generally  understood  that  the  search  and  detection  phases  of 
the  SDS  mission  are  intrinsically  probabilistic  in  nature.  However,  it  is 
important  to  also  understand  that  the  post-detection  phase  of  swimmer  neutrali- 
zation must  use  a probabilistic  description  of  the  problem.  This  is  due  to 
the  fact  that  the  target  (threat)  is  neither  perceived  by  the  system  as  a 
deterministic  point  whose  future  actions  are  accurately  known,  nor  can  It  be 
countered  by  elements  of  a neutralization  subsystem  whose  performance  is 
completely  reliable. 

The  first  post-detect ion/cl  ass i f ication  task  to  confront  the  system 
is  to  obtain  a usable  estimate  of  target  parameters  which  will  (1)  confirm 
or  establish  the  contact  classification  and  (2)  can  be  input  to  the  decision 
and  control  algorithms  which  will,  in  turn,  allow  optimal  deployment  of  the 
neutralization  subsystem  to  counter  the  threat.  The  target  state  estimate 
(TSE)  will  contain  such  elements  as  present  location  and  velocity,  probable 
objective  area,  and  the  most  likely  path  to  be  taken.  In  addition  the  TSE 
should  provide  measures  of  uncertainty  related  to  each  of  these  parameters 
in  a form  usable  by  both  the  operator  and  computer  for  deciding  on  the  next 
course  of  action. 

Obtaining  the  most  accurate  TSE  requires  (a)  automatic-sensor-supplied 
inputs  and  (b)  operator-supplied  estimates  of  the  situation  which  are  based 
on  a priori  data  and  the  operator ' s view  of  the  current  situation.  In  short, 
TSE  generation  requires  the  combination  of  data  inputs  which  are  inherently 
incompatible  in  their  dimensions  and  formats.  The  correlation  of  this  data 
by  automatic  means  is  far  beyond  the  capability  of  foreseeable  advances  in 
the  field  or  artificial  intelligence.  However  a significant  body  of  research 
is  being  done  which  indicates  that  the  operator  can  contribute  to  the  solution 
of  the  problem  with  the  aid  of  an  appropriate  man-machine  interface  (MMI) 
design. 
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The  nature  of  the  resulting  TSt  obtained  through  the  application 
of  this  emerging  technology  will  most  likely  be  a non-par ainet ric  representation 
of  a dynamic  probability  density  function  (PDF)  whose  future  location  and 
shape  can  be  generated  using  various  types  of  data  supplied  by  the  operator 
as  the  situation  develops.  Figure  i shows  a typical  display  containing  both 
the  original  sensor  Input  data  from  a field  of  fixed  sonobuoys , and  a possible 
modification  of  a target's  PDF.  Also  shown  Is  an  anticipated  threat  trajectory 
along  with  the  expected  terminal  PDF  at  some  future  time  as  generated  by  the 
operator . 

The  Neutralization  Subsystem  (NS)  of  a modern  SDS  will  most  likely 
contain  both  preset  and  terminally  guided  deterrents/neutralization  means 
which  are  deployed  from  a central  Command  and  Control  Center  (CCC).  A preset 
neutralization  device  (ND)  is  defined  as  hardware  which,  once  launched/ 
deployed,  is  no  longer  under  CCC  control.  A terminally  guided  ND  may,  however, 
be  controlled  from  the  CCC  after  it  is  launched/deployed . In  cases  when  the 
terminally  guided  ND  is  a weapon  such  as  an  anti -swimmer  wireguided  torpedo 
or  a radio  controlled  boat  dropping  explosive  charges,  effective  terminal 
control  is  required  for  successful  system  operot ion. 

In  Figure  2 we  see  a potential  application  of  a heurist ical ly- 
derived  target  PDF.  This  PDF  represents  the  uncertainty  in  a target's  loca- 
tions as  a function  of  time.  The  problem  begins  with  an  initial  PDF  at  the 
left  hand  of  the  figure  and  ends  with  a terminating  PDF  at  the  right  hand  of 
the  figure.  The  specific,  problem  is  to  determine  the  optimum  launch  time  of 
a neutralization  device  which  is  located  as  indicated  in  the  figure.  If  the 
neutralization  subsystem  employs  a straight-running,  acoustic  homing  weapon 
which  has  a proximity  type  fuse,  then  the  kill  probability  is  proportional 
to  the  ratio  of  the  shaded  area  to  the  total  area  of  the  PDF  as  indicated  in 
the  figure.  It  is  seen  that  if  the  neutralization  subsystem  is  constrained 
to  remain  at  its  current  location,  then  the  optimal  deployment  procedure  is 
to  wait  until  time  T^  and  then  lauch  the  weapon  to  achieve  the  highest  kill 
probability.  if,  howc.ver,  the  neutralization  subsystem  can  be  moved  during 
the  countermeasure  operation,  then  an  even  higher  kill  probability  could  be 
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Figure  2.  Optimal  Search  of  Dynamic  Non-Parametric 
Target  Distributions.  . 


achieved  if  the  system  is  displaced  as  shown  and  the  weapon  launch  is  per- 
formed at  T^. 

1.2  STATEMENT  OF  THE  RESEARCH  PROBLEM 

The  purpose  of  this  work  was  to  develop  interactive  methods  for 
allowing  a system  operator  to  input  data  that  permits  the  computer  to 
generate  a dynamic  sequence  of  non-parometr ic  probability  density  functions 
represent'!  ng  the  target's  motion.  These  NPPDF's  would  i ncorporote  the  "best 
information"  provided  objectively  by  the  machine  and  subjectively  by  the 
system  operator. 

The  data  input  by  the  SOS  operator  ate  heuristic  representations  of 
current  target  state  uncertainty  and  the  probable  future,  evolution  of  the 
uncertain  target  states.  The  algorithms  developed  should  allow  the  human  to 
deal  in  a familiar  tactical  space  through  the  use  of  an  interactive  graphics 
device.  The  graphical  representations  of  uncertainty  in  target  location  and 
motion  should  be  translatable  into  the  probability  density  function  format. 
In  general  these  PDF's  will  be  non-parometr i c , nevertheless  the  data  thus 
derived  should  be  machine  usable  for  subsequent  SDS  functions  such  as  sensor 
reallocation  and  neutralization  subsystem  control  optimization. 
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2.0  SDS  APPLICATION  OF  HEURISTIC  INFORMATION  PROCESSING 


This  section  provides  more  detailed  background  information  relevant 
to  the  specific  tasks  performed  in  this  study  than  was  given  in  Section  1. 

Much  of  the  work  which  has  contributed  to  development  of  this  background 
information  has  been  done  at  ISC  in  relation  to  a broader  area  of  combat 
systems  research  than  that  performed  for  the  SDS. 

The  following  subsections  introduce  the  primary  differences  between 
systems  which  are  restricted  to  using  parametric  PDF's  and  potential  future 
systems  having  the  capability  to  incorporate  NPPDF's  in  the  decision  making 
process.  Examples  in  non-SDS  areas  are  included  to  illustrate  the  wider  use 
of  this  technology.  We  conclude  this  section  by  describing  in  non-mathemat i cal 
terms  how  NPPDF's  are  generated  and  caused  to  evolve  or  move  in  the  tactical 
time  frame, 

2.1  TACICAL  DECISION  MAKING  WITH  PARAMETRIC  PDF's 

The  use  of  deterministic  algorithms  to  process  tactically  relevant 
data  often  results  in  unacceptable  system  performance.  Recognition  of  this 
fact  has  caused  the  implementation  of  various  forms  of  probabilistic  models 
in  many  fleet  systems.  The  algorithms  used  to  represent  uncertain  knowledge 
require  statistical  assumptions  to  be  made  concerning  the  nature  of  the 
observed  data  and  the  underlying  process  describing  the  phenomenon  under 
observation.  These  assumptions  are  seldom  realistic. 

The  processed  output  of  these  algorithms  represent  the  uncertainty 
in  the  system  solution  as  a very  regularly  shaped  parameterized  distribution, 
usually  multi-variate  Gaussian.  Experienced  system  operators , of  course, 
realize  that  these  parameterized  distributions  do  not  truly  represent  the 
total  knowledge  available  about  the  problem.  In  other  words,  the  human 
operator  knows  that  the  real  world  is  not  exactly  represented  by  a combination 
of  overlapping  mounds  of  circular  or  elliptical  shapes  that  have  to  interact 
with  other  distributions  perhaps  represented  by  rectangular  boxes  and  circles 
of  the  so  called  "cookie  cutter"  family.  Even  though  this  simplistic 


representation  of  uncertainty  serves  to  remind  the  operator  that  he  is 
dealing  with  probabilistic  instead  of  deterministic  data,  the  operator  is 
still  forced  to  perform  a parallel  sequence  of  mental  computations  to  correct 
the  idealized  distributions  in  the  system.  This  mental  picture  is  a complex 
formulation  of  uncertainty  which  can  no  longer  be  accurately  represented 
parametrically.  Also  it  Is  not  feasible  to  generate  the  theoretically  obtalrt- 
able  composite  PDF  using  automatic  means  because  often  the  operator  would 
modify  the  resulting  nonparametr ic  PDF  with  knowledge  that  does  not  reside 
within  the  system  in  machine-usable  form.  Furthermore,  even  if  we  begin  with 
parameterized  representations  of  tactica'  uncertainty  and  wish  to  proceed  on 
some  optimal  course  of  action,  we  find  that  we  are  quickly  forced  to  deal  with 
non-parametr ic  or  more  generalized  representations  of  probability  density 
f unct i ons . 

Therefore  the  resulting  modes  of  operation  of  these  interactive  tac- 
tical systems  require  a large  measure  of  operator  skill  which  must  be  obtained 
through  (a)  long  on-thc-job  experience  in  developing  the  modified  representa- 
tions of  tactical  knowledge  and  (b)  mentally  performing  a parallel  pioccssing 
of  this  knowledge.  An  analog  of  this  process  may  be  called  appl i cal  ion  of  modern 
"Kentucky  Windage"  techniques.  These  procedures  using  parametric  PDF  repre- 
sentations are  inherently  inefficient.  Nevertheless  they  do  provide  a me.asur- 
able  performance  increment  over  systems  which  do  not  account  for  the  unreli- 
ability of  ei  tiler  the  input  data  or  the  intermediate  system  solutions. 

2.2  THE  NON-PARAMETR I C PROBABILITY  DISTRIBUTIONS  FUNCTION  (NPPDF) 

NPPDF's  in  a tactical  system  may  be  generated  by  the  machine  auto- 
matically, by  the  system  operator,  or  by  the  system  operator  modifying  machine 
generated  PDF's.  The  most  likely  method  tv  which  NPPDF's  will  be  generated 
during  operational  situations  is  the  operator  using  a graphic  input  device 
supplied  as  part  of  the  interactive  tactical  system. 

Also  see  Section  2.2.1  below. 
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Wo  show  In  FI  euro  3 an  example  of  how  an  operator  may  furnish 
Information  about  the  location  of  an  object  through  the  generation  of  a 
NPPDF.  The  figure  shows  a bl -modal  NPPhF  comprised  of  five  contours.  The 
outer  contour  designated  CI.O  represents  a region  In  tiro  horizon  place  In 
which  the  system  operator  believes  that  the  target  is  contained  with  a high 
degree  of  certainty.  The  next  two  nested  contours  labeled  C.9  represent 
two  regions  of  space  where  he  believes  the  target  may  be  found  with  proba- 
bility of  .9.  The  final  two  nested  closed  contours  labeled  0,5  represent 
regions  of  the  space  where  the  system  operator  believes  the  target  may  be 
found  with  probabl  1 1 t.y  0. 5.  These  contours  termed  Continuous  Subjective 
Functions  (CSF)  or  Sketch  Models  may  be  generated  by  the  system  operator 
using  both  quantitative  and  qualitative  Information  about  an  object  (target) 
whose  location  Is  not  precisely  known. 

CSF's  have  already  demonstrated  their  utility  In  the  characterization 
of  parametric  probability  density  functions.  This  rese.m.h  performed  at 
ISC  demonstrates  that  the  human  operator  Is  capable  of  using  (subjective) 
knowledge  other  than  the  objective  knowledge  presented  by  a set  of  observed 
sample  points  to  describe  the  parametric  distribution  from  which  the  sample 
was  drawn. 

The  extension  of  the  intuitively  appealing  conclusion  of  this  work 
Is  depleted  in  Figure  lr,  Mere  we  see  three  curves  schemat I ca)  1 y representing 
the  quality  of  a solution  to  a hypothetical  tactical  problem.  The  quality 
of  the  solution  Is  plotted  as  a function  of  the  amount  of  data  available  to 
the.  total  system  - man  and  machine.  Three  system  operational  modes  are 
depicted,  In  the  first  mode  the  machine  In  operating  autinoaLic.nl  ly  with  no 
operator  assistance.  Here  the  machine  requires  a certain  minimum  amount  of 
objective  data  prior  1 0 being  able  to  generate  any  typo  of  usable  solution. 
The  second  mode.  Involves  only  the  opoalor.  It  Is  known,  of  course,  that 
the  human  can  begin  to  generate  solutions  on  very  little  or  no  objective 

See  Appendix  1)  for  a more  detailed  discussion. 
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F^ure  h.  Potential  S 
use  of  Open 


data.  From  sparse  subjective  data  alone,  usable  solutions  can  often  be 
obtained.  (Often  we  term  this  reult  also  as  "going  off  half  cocked.")  It 
is  shown  that  for  estimating  parametric  distributions  from  sampled  points 
the  machine  operating  alone  could  be  outperformed  by  the  human  operator  up 
to  a certain  sample  size  (amount  of  available  data).*  At  that  point  a per- 
formance crossover  occurred  and  the  machine  performed  bettor. 

We  point  out  here  that  the-  above  research  was  conducted  using  only 
parametric  distributions  to  generate  the  operator  displayed  samples,  It  is 
easy  to  conceive  of  realistic  tactical  examples  where  non -parametric  PDF's 
would  occur  in  which  a usable  totally  automatic  solution  would  be  impossible 
for  the  machine  to  obtain. 


it  is  a fundamental  hypothesis  of  the  larger  area  of  research  which  i 

includes  the  current  work  that  man  and  machine  operating  In  concert  can  deliver 
a system  performance  gain  which  would  make  the  quality  of  the  man/machlne  solu-  | 

tion  asymptotically  approach  the  machine-alone  solution  when  an  Infinite  amount 
of  data  was  available  to  the  total  system.  This  Is  Illustrated  by  the  topmost  i 

curve  In  the  figure. 

In  addition  to  the  examples  already  discussed  in  preceding  sections 
we  examine  a further  example  ■Vawn  from  a mine  countermeasures  (MCM)  mission, 

Figure  5 shows  a horizon  plane  display  of  a minefield  that,  is  in  the  process 

1 

of  being  cleared.  Here  the  overall  problem  of  the  tactical  MCM  system  Is  to 
develop  time-optimal  mine  hunting  policies  that  account  for  the  mine  sweeper 
kinematic  constraints,  mine  hunting  sonar  unreliability,  and  navigational 
errors.  The  mission  is  to  reduce  the  threat,  of  the  minefield  to  a prcdcsig-  j 

nated  level.  The  initial  mine  hunting  tactic  will  most  likely  bo  developed 
using  o uniform  a priori  distribution  of  the  location  of  the.  mines  In  the 
minefields.  Additional  information  will  become  available  to  the  system  opera- 
tor after  the  operation  in  the  minefield  begins  and  several  mines  are  detected, 
localized,  and  neutralized.  This  information  would  be  used  to  update  the  mi ne 
hunting  tactics  In  such  a way  as  to  most  efficiently  use  the  remainlngtesourc.es. 

"Use  ol  Interactive  Graphics  for  Continuous  Subjective  Judgment,"  Doctoral 
Dissertation  by  Gary  W.  Irving,  In  progress. 
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Figure  5.  Operator  Generated  NPPDF  for  MCM  Mission 
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(n  this  example  we  have  assumed  that  the  system  operator  knows  not 
only  the  location  of  the  neutralized  mines  but  also  that  the  mines  were  laid 
by  aircraft.  This  means  that  they  lie  in  more  or  less  linear  patterns  across 
the  area  to  be  cleared.  If  the  minefield  is  in  coastal  waters  where  known 
anti-aircraft  (AA)  weapons  and/or  land  features  would  preclude  the  mine 
laying  airplanes  flying  certain  paths  or  if  other  a priori  knowledge  is  known 
from  radar  tracks  of  how  airplanes  crossed  the  minefield  regions,  then  this 
information  could  be  incorporated  by  the  operator  to  generate  NPPDF's  desig- 
nating the  probable  locations  of  the  undiscovered  mines.  The  second  part  of 
Figure  5 presentsan  operator  generated  NPPDF  showing  the  probable  locations 
of  the  undiscovered  mines.  With  this  machine-usable  information  the  mine 
hunting  system  can  now  compute  optimal  search  and  scan  trajectories  that  enable 
the  required  minefield  threat  level  to  be  achieved  in  minimum  time. 

2.2.1  NPPDF  Generation 

The  fact  that  today's  systems  are  beginning  to  incorporate  simple 
parametric  representations  of  knowledge  is  due  primarily  to  historical  con- 
vention and  the  requirements  of  computational  ease.  In  order  to  obtain 
Implementable  mathematical  models  oT  uncertainty  in  the  past,  the  distribu- 
tions had  to  have  analytical  simplicity.  Today's  systems  are  thus  incor- 
porating automated  tactical  decision  models  based  on  gauss i an  and  "cookie- 
cutter"  definitions  of  observation  and  process  noise.  And  as  shown  by 
numerous  simulation  studies,  those  combat  systems  do  perform  better  than 
their  predecessors  which  were  forced  to  "model  the  world  deterministically." 
Formally  important  command  and  control  systems  important  questions  still 
remain  to  be  answered.  These  are: 

1.  What  is  the  true  performance  increment  of  systems  which 
parametrically  model  uncertainty,  over  systems  which  have 
no  explicit  analytical  models  of  noise? 

2.  To  what  extent  must  these  system-generated  outputs  be 
modified  by  man  before  they  can  be  used  to  obtain  an 
improvement  in  the  overall  solution  to  the  tactical 
problem? 
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The  combat  system  user  often  modifies  the  output  or  implements  a 
neighboring  solution,  we  feel,  because  he  knows  that  the  machine  did  not 
have  the  "true  picture"  of  the  situation.  This  behavior  lends  support  to 
the  hypothesis  that  in  actual  operational  situations  the  representation  of 
uncertain  knowledge  is  almost  always  best  represented  by  probability  dis- 
tributions of  irregular  shape  (i.e.,  NPPDF's).  Perhaps  even  a stronger 
impetus  to  study  NPPDF's  is  drawn  from  the  realization  that  even  if  the 
original  PDF's  at  some  point  in  the  combat  system  were  in  truth  parametric, 
they  would  become  non-parametr tc  as  soon  as  we  began  operating  with  them. 
Therefore  in  obtaining  any  realistic  optimal  sequence  of  decisions  we  would 
be  forced  to  treat  NPPDF's  in  the  process  of  solving  the  tactical  problem. 

We  illustrate  this  in  Figure  6 by  examining  the  search  for  a target 
whose  location  is  represented  by  a stationary  bivariate  normal  distribution. 
For  s impl i ci ty  we  wi 1 1 assume  the  sensor  is  perfectly  reliable — that  is,  if 
the  target  actually  is  in  the  snesor's  observation  area,  then  the  sensor  will 
report  its  presence  with  probabi  i i ty  equal  to  1 .0.  S i nee  the  observat  ion  area  i s 
"smaller"  than  the  target's  PDF,  a sequence  of  observations  from  a moving 
sensor  will  generally  be  required.  The  figure  illustrates  the  evolution  from 
a parametric  PDF  (at  time  tg)  to  a clearly  non-parametr ic  PDF  (at  time  t-j) 
as  the  sensor  proceeds  with  the  search.  The  PDF  is  represented  by  the 
C.5equal  likelihood  contour  which  initially  (tg)  is  an  ellipse  and  then 
evolves  into  a bigger  ellipse  with  a slice  cut  out  as  the  unsuccessful  search 
continues. 

It  is  clear  that  if  at,  say  t£,  the  searcher  decided  to  pick 
a new  sweep  course,  or  commit  an  additional  sensor  to  the  search,  then 
he  should  do  that  with  regard  to  the  current  state  of  knowledge  at  as 
represented  by  the  NPPDF.  In  the  same  vein  any  formalized  optimal  search 
algorithm  must  also  have  the  ability  to  treat  NPPDF's  if  it  seeks  to  treat 
the  operational  problem  realistically. 

5<The  0.5  contour  represents  the  region  of  space  under  a PDF  where  the  searched 
for  target  is  actually  located  with  probability  .5-  The  uniqueness  of  the 
contour  for  any  shape  of  PDF  is  obtained  by  requiring  all  P-contours  to  co- 
incide with  the  PDF's  equal  likelihood  contours  that  satisfy  the  preceding 
definition.  (See  Section  2.4) 
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Another  frequently  occurring  situation  where  NPPDF's  arise  is 
illustrated  in  Figure  7-  Here  we  show  the  location  of  a target  of  interest 
as  initially  estimated  by  a Kalman  filter.  However,  other  a priori  knowledge 
that  was  not  processed  by  the  filter  algorithm  (either  because  it  was  not 
capable  of  receiving  or  using  the  additional  inputs)  would  cause  the  system 
user  to  modify  the  parametric  representation  of  the  target's  location.  He 
could  do  this  mentally  by  identifying  areas  under  the  PDF  which  have  a very 
low  probability  of  containing  the  target.  Were  the  system  user  able  to  supply 
the  system  with  this  data,  the  NPPDF  shown  in  the  right  hand  side  of  the  fig- 
ure would  result.  This  distribution  would  now  represent  a more  accurate  state- 
ment of  knowledge  and,  if  properly  used,  would  theoretically  contribute  to 
better  system  performance.  Thi  s possi bi 1 i ty  is  di scussed  i n the  remainder  of 
Section  2. 


In  the  real  world  of  tactical  systems  the  situation  is  somewhat 
different  from  that  implied  in  the  preceding  paragraph.  The  system  user's 
problem  solving  sequence  currently  employs  a less  efficient  routine  that  is 
forced  to  rely  on  a cumbersome  synergism  between  man  and  the  machine.  This 
situation  is  illustrated  in  Figure  8.  Part  A of  the  figure  indicates  a 
typical  information  flow  that  has  a combat  system  processing  measured  environ- 
mental input  and  computing  a solution.  This  solution  may  bo  used  hy  the  next 
system  stage  (either  another  problem  solving  system  or  a response  system)  as 
it  is;  or,  as  is  usually  the  case,  it  is  displayed  to  an  operator  who  modifies 
the  solution  and  passes  itonas  indicated  by  the  switch  position  in  the  figure. 
In  this  way  the  overall  system  obtains  the  benefit  of  a more  accurate  repre- 
sentation, of  knowledge,  although  the  likely  result  is  that  the  overall 
solution  suffers.  This  is  so  because  the  operator  is  forced  to  intervene  in 
both  the  input  and  processing  functions  of  the  machine  by  modifying  the  sys- 
tem's solution.  If  this  is  done  in  a multi-stage  process  as  shown  in  Figure 
8(B),  then  a significant  difference  between  the  hands-on  and  hands-off  solu- 
tions could  occur  with  neither  being  necessarily  the  best  solution  possible. 

By  "best  solution"  we  mean  one  where,  the  operator  supplies  inputs  that  incor- 
porate information  from  diverse  sources  (not  available  to  even  the  most 
visionary  systems  of  the  foreseeable  future),  and  the  machine  performs  the 
data  processing  functions  to  generate  optimal  solutions. 
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Figure  7-  An  Example  of  a NPPDF  Generated  by  thing  Data  Not 

Available  to  or  Processed  by  Current  System  Algorithm 


I 

] 

I 


t 

[ 

[ 

1 

I 


c 

<u 

O 

4-» 

i — 

m 

✓ — s 

u 

L» 

> 

c 

*— 

c 

U Q 

CO 

c 

o 

+-» 

o 

o o 

o 

OJ 

• — 

« — 

» — - 

V) 

c 

E 

L» 

ra  M- 

TO 

■M 

• — 

O 

O 

3 

L • — 

3 

3 

o 

■M 

*— 

Qi  X> 

■M 

» — 

a> 

cn 

O 

CL  o 

o 

o 

o 

«— 

< 

CO 

o 3: 

< 

CO 

' — ' 

u 

CJ 

o 


5 

<U 

^ i- 

O “O 

m x 


< 5 


<u 

VI 

c 

o 

CO 


CL  O) 
E • 
— O 


oH 


u 

o 

E 

<U  <0 
+j  L. 
v>  <D 

>.  CL 

co  o 


cn 

o 


c 

<D 

E 

c 

O 


c o 
O fo 

c — h- 

O VJ 

u — nJ  >• 

— i/>  3 E 

> V)  4-J  Oi 

c •—  *—  c 
i±i  x.  co  ui 


o 


o' 

o 


< 

o 

Q- 

>- 


I 


I 


I 


o 

oC 


oo 

or: 

o 

co 


4 

o 

o 

o 

o 


> 

LU 


c 

d>  o 
<U  — 
5 


c 

o 


a. 

o 

0 

1 

<D 

JC 


0) 

CQ 


I 4-J 

c 3 


I o 

c CO 


(D  Q)  4J 
E « 3 
0 — 
LJ  ^ o 
a>  n » co 
O < <D 
c cn  *o 
o >«  fO  <u 


a>  — co  u- 
L—  ro  — 
^"^-0-0 
— O C O 
o h-  (v  2: 


u 

— c 


z 

LU 

CO 

Ui 

C£L 

CL 

LU 

a: 

o 


< 

3: 

UJ 


o 

CO 


h- 

3 


o 

CO 


< 


3= 


Q 

Ui 

fsl 


< 

a: 

ui 

UJ 

o 


i_ 

o d 
c — 


*•»  a> 
o 


t/i 

E 

<u 

+-» 

cn 

>- 

co 


c 

<D 

u 

L. 

3 

O 


cn 

c 

o 


o 

co 

E 

<D 

X) 

O 

u 

CL 


<0 

o 


u 

ni 


c 

o 


<0 

u 

(1) 

c 

<D 

o 

d) 

jc 


c 

o 


ro 

*•> 

c 

a) 

CO 

<D 

u 

a. 

Ci 

oc 


co 


3 

cn 


fO 

<u  O a 
O co  co 


-IS- 


2,2.2  NPPDF  Dynamics 

There  are  two  ways  to  examine  the  future  dynamic  behavior  of  NPPDF's. 
One  way  is  to  define  (a)  an  initial  PDF  at  some  time  t0  and  a terminal  PDF  at 
some  time  tj , and  (b)  a nominal  path  of  how  the  PDF  evolved  from  tg  to  tj.  An 
algorithm  using  statistical  sampling  of  these  terminal  NPPDF's  can  then  be 
used  to  generate  an  Intermediate  PDF  as  shown  in  Figure  9.  In  such  fashion 
a number  of  intermediate  PDF's  could  be  generated.  Another  algorithm  described 
below  can  be  used  now  to  continuously  "evolve"  each  contour  segment  between 
the  defined  and/or  sampled  intermediate  PDF's. 

A second  method  of  predicting  the  future  behavior  of  NPPDF's  is  to 
define  an  original  PDF  specifying,  say,  the  positional  information  of  a 
target  and  define  a derivative  distribution  which  characterizes  the  uncer- 
tainty in  the  knowledge  of  the  target's  velocity,  This  is  shown  in  Figure 
10.  A new  terminal  PDF  can  be  generated  at  some  time  in  the  future  by 
sampling  both  the  locational  and  the  derivative  distributions  and  applying 
the  derivative  distribution  value  to  the  locational  sample.  The  smooth 
transition  from  the  original  supplied  NPPDF  and  the  terminal  distribution 
would  be  obtained  through  a specialized  algorithm  described  below. 

The  contour  interpolation  algorithm  summarized  in  Figure  11  permits 
the  smooth  interpolation  of  an  arbitrary  initial  contour  to  a terminal  contour 
in  such  a way  the  the  evolution  of  the  intermediate  contours  is  controlled  by 
two  designated  constraint  boundaries.  The  algorithm  uses  these  input  data  to 
numerically  compute  a grid  of  internal  points  that  define  what  may  be  called 
minimal  polynomial  designators  with  points  on  the  terminal  contour.  These 
designators  may  be  visualized  as  being  akin  to  the  Lagrangian  solution  of 
field  lines  or  hydrodynamic  flow  streamlines.  If  a more  complex  evolution  is 
required  between  initial  and  terminal  contours,  then  an  intermediate  contour 
showing  the  more  complex  solution  can  be  defined.  The  interpolated  contour 
now  will  proceed  from  the  initial  contour  through  the  intermediate  contour  to 
the  terminal  contour.  (t  is  also  possible  to  vary  the  transit  speed  in  the 
contour  interpolation  algorithm.  A graph  of  this  is  shown  in  the  figure  whete 
the  transit  speed  of  the  evolving  contour  could  be  a non-linear  function  of 
the  a long-boundary  distance. 
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Thi'  technique.  summarized  in  Figure  li  wind cl  i>o  used  to  govern  the 
dynamic  behavior  of  contour  segments  of  HPI'fiPs  that  wore  obtained  through 
the  processes  simuii.tr  i /oil  In  figures  9 and  1(1. 

before  concluding  this  section  we  rc'examlno  figure  10,  the  lower 

right  bond  side  of  the  figure  we  sec  two  enmhinat  Ions  of  three  estimates  ol 
Initio)  steles  evolving  into  two  possible  terminal  coiihln.it ions.  This  Is  a 
schematic,  representation  of  how  subjectively  supplied  lnform.it  ion  tor,  y be 
examined  with  a tactical  system  having  the  unpaid  i I ty  to  maul  pu  tale  NI’IMlt'x, 
The  schematic  shows  that  the  definitions  of  the  three  Initial  stales  piovlded 
by  various  members  of  the  commando.!' 1 s staff  may  have  a large  degree  ol  con- 
currence as  shown  In  the  lower  part  of  the  figure.  On  the  other  hand , there 
may  be  wide  variance  os  shown  In  tire  upper  part  of  the  figure,  loch  member 
could  define  not  only  the  locational  distribution  but  also  his  best  estimate 
of  wh.it  the  derivative  dlsti (button  Is  and  allow  the  machine  to  evolve  tin* 
future  state*.,  of  uncertainty  as  shown.  it  would  then  he  possible  to  see  that 
the  Individual  Initial  states  as  they  evolve  could  either  i emu  In  together  or 
disperse.  Presentation  ol  these  result-,  to  the  commanding  officer  (decision 
maker)  would  allow  him  to  deduce  the  degree  of  concurrence  or  variance  of  the 
estimates  of  the  situation  existing  among  his  staff. 
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3.0  DESCRIPTION  OF  INTERACTIVE  NPPDF  ALGORITHMS 


Two  different  approaches  to  the  Interpolation  of  non-pa rametric 
probability  distribution  functions  have  been  Implemented.  The  first  of 
these  Interpolates  contours  constrained  by  boundaries,  and  Is  described 
In  Section  3*1.  The  second  algorithm  interpolates  between  Individual 
samples  of  the  Initial  and  final  distributions.  This  interpolation  takes 
place  In  a linearized  coordinated  system  determined  by  the  operator  input 
of  the  distributions  mean.  This  algorithm  is  described  in  Section  3-2. 

Note  that  both  algorithms  described  below  are  combinations  of 

a)  Simple  geometric  transformat  ion,  and 

b)  Linear  interpolation; 

and  hence  might  be  expanded  to  utilize  more  complex  transformations  or  other 
I nterpolet i on  schemes . 

3 . i The  Contour  Intel  point  Ion  Algorithm 

The  contour  iniorpoint  ion  algorithm,  shown  in  Figure  12,  assumes  initial 
and  final  contours  (fg  and  i'^)  and  al  so  transition  boundaries  (/'  and  (,')  descr  i b i ng 
the  uvolullonof  the  endoolntsof  the  contours  arc  gi von  as  shown  in  Figure  12(a). 
(a).  There  are  four  basic  steps  to  this  algorithm: 

1.  The  transition  boundaries  ere  divided  into  N equal 
length  segments. 

2.  The  Initial  and  final  contours  are  transformed  to  a new 
coordinate  system  Indicated  by  primed  variables.  The 
Initial  contour  Is  moved  so  that  its  bottom  endpoint  Is 
at  the  origin,  anti  rotated  so  that  the  other  endpoint 
Is  along  the  Y-axis.  The  final  contour  is  similarly 
displaced  and  rotated,  but,  In  addition  it  is  stretched 
or  shrunk  so  that  Its  chord  length  (endpoint  to  endpoint) 
agrees  with  that  of  the  initial  contour  as  shown  in  Figure 
12(b) . The  end  result  Is  that  the  Initial  and  final  con- 
tours have  been  transformed  so  that  their  endpoints  match. 

3.  An  Intermediate  contour  In  the  primed  coordinate  system 
Is  calculated  hy  Interpolating  between  the  initial  and 
final  contours  in  the  primed  system. 
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b.  The  final  intermediate  contour  Is  a rotated  and  stretched/ 
shrunk  version  of  the  primed  Intermediate  contour  displaced 
back  to  its  appropriate  endpoints  In  the  unpr lined  coordinate 
system. 

Again,  referring  to  Figure  12(a)  and  (b) , the  equations  used  to 
perform  these  steps  are: 

1(a)  Divide  the  transition  boundaries  Into  N equal  segments 
specified  by  points  {P^J.tQ^},  n*0,N. 

1(b)  Calculate  C , the  distance  from  P to  0 , and  0 , the 
n n n n 

angle  of  the  line  P Q from  the  vertical,  for  nK0  to  N 
3 n n 

2(a)  Calculate  6’^'.  Move  P^  to  the  origin  and  then  rotate 
Cq  through  0Q. 

2(b)  Calculate  C ' . Move  PN  to  the  origin,  rotate  C’N  through 

*"0 

0 and  multiply  y coordinates  by  ■=—  . 

N N 

2(c)  Divide  and  into  M equal  length  segments  specified 
by  points  (lO,  (Sn))  m»0,M  respectively. 

3 Calculate  the  points  (T  ) which  specify  C ' , a linear 

r m n 

interpolation  between  and  . 

T » R + £ S 

— m N — m N — m 

where  the  underline  indicates  the  vector  notation  for  the  points. 
i»(a)  Stretch/Shrink  C ' 


4(b)  P.otate  through  -0  and  displace  back  to  P^,  the  n**1  point 
on  the  lower  transition  boundary. 


I 

I 


.j 


3.2  The  Sampling  Algorithm 


The  Sampling  Algorithm  assumes  that  the  isoprobability  contours 
describing  the  initial  and  final  distributions  along  with  a description  of 
the  mean  path  are  given.  Again,  there  are  four  basic  steps  to  this  aigorithm 

1.  Sample  the  initial  and  final  distributions. 

2.  Transform  these  samples  to  a primed  coordinate  system.  In 
this  case  the  primed  coordinate  system  is  one  where  the  mean 
path  has  been  transformed  onto  the  x-axis. 

3-  Interpolate  between  these  transformed  samples  to  find  the 
transformed  intermediate  samples. 

*».  Transform  the  intermediate  samples  back  to  the  original 
coordinate  system. 


Now,  referring  to  Figure  13,  the  equations  used  to  implement  this 
procedure  are: 


1(a)  Assume  initial  contours  {C  },  and  final  contours  { D } 

n n 

with  cumulative  probabilities  Pn  describing  regions 

{R  ).  { S,. } , for  n = 0,N.  Pn  must  be  1.0,  and  P must  be 
n N u n 

monotonies] ly  decreasing.  Pick  a total  sample  size  M, 

and  calculate  the  number  of  samples  1^  required  in  each 

region  P»  or  S 
n n 


I = - pn  ,)  M + 0.5  j n - l,  N-l 

n L'  n nl  ’ J truncation 

I = (p  )m  + 0.5  I 

^ -I  truncation 


Adjust  Iq  to  maintain  a total  of  M samples 
N 

'n 

n=l 


-28- 


1(b)  Circumscribe  each  contour  {6'..)  and  {/A,}  with  a rectangle. 

N N 

1(c)  Begin  with  the  initial  distribution.  Pick  a random  sample 

from  the  largest  rectangle  as  follows:  Let  the  rectangle 

be  described  by  x . , x , y . , y then  the  sample 
' min  max  mm  'max  r 

coordinates  are 


Xxamp 1 e 
^sample 


= x . + (x  - x . ) Z, 

nun  max  min  1 

s=  Y + ( v - y ) z 
'min  'max  min  2 


where  Zj  and  Z2  are  random  numbers  in  the  range  [0,1]. 

Determine  if  the  sample  is  in  Rq,  Rj , R2  or  outside  all 
the  contours.  If  it  is  in  a region  R^  and  the  quota  1^ 
for  that  region  has  not  been  filled,  save  the  sample  point; 
if  not,  pick  another  sample  and  repeat.  Once  the  outermost 
region  Rq  has  been  filled,  pick  samples  from  the  rectangle 
enscribing  Rj-  Then  once  has  been  filled  use  the  rec- 
tangle enscribing  R2  and  so  on  until  all  the  quota  1^  have 
been  filled.  Do  the  same  for  the  final  distribution. 

2(a)  Move  the  initial  samples  to  the  origin  and  rotate  them 
through  0.  (the  angle  between  the  mean  path  and  the 
position  x-axis  direction^,  and  call  the  rotated  samples 
{U^},  k - 1 ,M  as  shown  in  Figure  lA, 

2(b)  Similarly,  referring  again  to  Figure  14,  rotate  the  final 
samples  through  0^,  then  move  them  out  to  (£^,0)  where 

Is  the  length  of  the  mean  path,  and  call  them  {V^},  k=l ,M. 

3 Interpolate  between  {U^}and  {V^}  according  to  path  length 
to  obtain  intermediate  samples  {W^} 


Wk  = 


_E L 


vk  k - l.N 


where  £j  is 
mean  path. 


the  distance  from  the  origin  to  point  j on  the 
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Figure  I1*.  Sampling  Algorithm  - Prired  Coordinate  System 


k The  Intermediate  samples  are  then  rotated  through  (K , 
and  displaced  to  (x^,  y.). 

The  next  stage  of  processing  would  be  to  draw  Isoprobability  contours 

E , n«0,N  for  this  intermediate  distribution.  This  requires  the  estimation 
n 

of  the  actual  intermediate  probability  density  function  from  the  set  of  sam- 
ples (W^i.  k «*  l,M.  Because  we  are  concerned  with  complex  distributions, 
simple  estimators  such  as  that  proposed  by  Parzen  are  not  sufficient.  Fortu- 
nately, the  variable  kernel  approach  recently  proposed  by  Breiman,  Meisei,  and 
Purcell  (See  Appendix  C)  seems  appropriate.  However,  the  results  of  our  own 
testing  do  not  replicate  the  qualitative  behavior  described  by  the  authors 
even  though  the  final  accuracies  are  similar.  Because  of  this,  no  NPPDF 

estimator  has  been  incorporated  in  the  sampling  algorithm.  Also,  it  must  be 

2 

noted  that  the  algorithm  as  originally  proposed  requires  approximately  ION 
exponential  function  calls.  With  200  nsec  required  to  generate  an  exponential 
on  a V 73  computer  with  floating-point  hardware,  a sample  size  of  N - 1*00  points 
would  take  6 minutes  of  processing  time.  The  development  of  an  adequate 
contour  algorithm  therefore  will  be  undertaken  during  a succeeding  phase  of 
this  research. 
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4.0  SOFTWARE 


Both  the  contour  interpolation  and  the  sampling  algorithms  have  been 
programmed  for  a Varian  V- 73  minicomputer  equipped  with  an  Information  Displays 
4-color  vector  interactive  graphics  terminal,  trackball,  and  function  keyboard 
(See  Figure  15).  Both  algorithms  have  the  following  characteristics: 

• Highly  Interactive 

• Use  of  color  to  enhance  clarity  of  displayed  information 

• Operator  entry  of  contours  via  trackball 

• Program  control  via  function  keyboard. 

The  following  two  subsections  describe  the  operation  of  the  software.  Actual 
listings  of  the  programs  are  provided  in  Appendices  A and  B. 

4 . 1 The-  Contour  Interpolation  Program 

The  operat ion  of  th i s program  requi res  an  operator  to  fi rst  enter  ini- 
tial and  final  contours , and  then  the  upper  and  lower  transition  boundaries  list  ng 
the  trackbal  I associated  wi  th  the  display.  Once  these  are  drown  the  program 
begains  automatically  and  can  be  halted,  continued,  or  restarted  at  will. 

The  specific  steps  are  (Referring  to  Figures  16  and  17): 

1.  Initially,  a cursor  (two  concentric  circles)  and  the  message 
"HOVE  CURSOR"  appear  on  the  screen.  The  operator  then  uses  the 
trackball  to  position  the  cursor  to  the  starting  point  of  the 
initial  contour.  When  ready,  the  button  at  the  lower  right 
corner  of  the  function  keyboard  labeled  "MOVE/DRAW"  is  pressed 
(See  Figure  17) . 


VAR  I AN  V-73 


Alphanumeric  Keyboard 


Figure  15.  Computer  System  for  NPPDF  Interpolation  Software 
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F i (jure  16.  operator  Flowchart  for  Contour  Interpolation  Program 
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2.  The  message  "DRAW  CONTOUR"  is  now  displayed.  The  opc rotor  then 
uses  the  trackball  to  draw  the  initial  contour  (contours  are 
colored  red).  Drawing  continues  until  "MOVE/DRAW"  is  pressed 
again.  This  terminates  the  contour.  Four  keys  arc  now  lit. 

If  the  operator  is  satisfied  with  the  contour  drawn,  he  hits 
"ENTER"  to  enter  this  contour  into  the  computer.  If  the  opera- 
tor wishes  to  redraw  this  contour,  he  presses  "ERASE  CONTOUR" 
or  "ERASE  ALTITUDE"  and  returns  to  Step  1. 

3.  When  the  Initial  contour  has  been  entered,  the  message  "MOVE 
CONTOUR"  again  appears.  The  operator  then  draws  the  final 
contour  as  in  Steps  1 and  2.  Before  pressing  "ENTER"  to  enter 
the  final  contour  drawing,  but  after  pressing  "MOVE/DRAW"  to 
terminate  it,  it  is  desirable  to  move  the  cursor  to  the  left 
(beyond  the  IniU-il  contour]  to  give  trackball  "room"  for  the 
following  ste^. 

When  the  final  contour  has  been  entered,  a cursor  appears  at 
the  starting  point  of  the  initial  contour.  The  operator  then 
draws  the  upper  transition  boundary  using  the  trackball.  The 
transition  boundaries  are  colored  green.  The  drawing  will 
automatically  end  when  the  cursor  reaches  the  starting  point 
of  the  final  contour.  The  cursor  should  then  be  moved  to  the 
left  again  before  pressing  "ENTER"  or  either  of  the.  erase 
buttons. 

5.  The  lower  transition  boundary  is  then  drawn  os  in  Step 

6.  Once  the  lower  trans 1 1 ion  boundary  has  been  entered  the  Inter- 
polation begins  automatically.  Three  keys  arc  lit:  "ON/OFF 
END  CONTOURS,"  "ON/OFF  BOUNDARIES"  and  "PAUSE  (RESTART)."  The 
The  first  two  of  these  allow  the  operator  to  turn  off  the  dis- 
play of  cither  the  initial  and  final  contours,  or  the  transition 
boundaries.  "PAUSE/RESTART"  freezes  (halts)  the  interpolation 
process;  pressing  It  again  restarts  the  1 ntorpolat ion  where  it 
left  off. 

PRESSING  ANY  OTHER  KEY  CAUSES  THE  PROGRAM  TO  RETURN  TO  STEP  I. 


I i 

i i 
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Note  that  the  Interpolation  u-.es  smoothed  contours  and  boundaries, 
so  that  the  Interpolated  contours  do  not  exactly  correspond  to  the  drawn 
ones  and  their  transition  boundaries.  The  Interpolated  contours  are  green. 

U . 2 The  Sampling  Program 

The  operation  of  the  Sampling  Program  falls  easily  into  3 parts  - Input 
of  the  I nl  1 1 a 1 and  f I nal  distribution,  input  of  the  mean  path  between  the  two  dis- 
tributions, and  specifying  the  point  on  the  mean  path  at  wh  ich  we  wi  sh  an  Interpolated 
distribution.  Figures  18  and  |y  contain  the  operator  flowchart  and  the  function 
keyboard  layout  for  thl  s program.  The  individual  steps  wi  till  rt  each  of  these  part  s are 

A.  Specifying  the  initial  and  final  distributions 

K Computer  displays  "INPUT  INITIAL  CONTOURS." 

2.  Computer  queries  "NO.  CF  CONTOURS"  and  the  operator  enters 
an  integer  N less  than  or  equal  to  the  maximum  number  of 
allowed  contours  (currently  5). 

3.  M - I. 

i».  Computer  queries  "CUMULATIVE  PROBABILITY  FOR  CONTOUR  M"  and 
the  operator  enters  an  integer  N less  than  or  equal  to  1 or 
the  last  cumulative  probability. 

5.  The  computer  displays  "DRAW  CONTOUR"  and  "MOVE  CURSOR."  The 
operator  moves  the  cursor  to  the  starting  point  of  the  con- 
tour and  presses  function  keyboard  button  labeled  "MOVE/DRAW 
The  operator  then  draws  the  contour  which  automatically  closes 
Itself  when  the  cursor  is  close  enough  to  t he  initial  starting 
point.  It  Is  possible  to  draw  more  than  one  contour  at  each 
probability  level.  To  do  th I s , move  the  cursor,  press  "MOVI / 

DRAW"  and  draw  the.  contour.  Once  the  contour (s)  has  been  drown, 
the  button  labeled  "ENTER"  accepts  the  contours  drawn,  "ERASE 
CONTOUR"  erases  the  last  contour  drawn  and  "ERASE  ALTITUDE" 
erases  all  the  contours  at  this  probability  level. 

6.  If  M » N,  go  to  Stop  7,  oterwlse  go  to  Step  3 with  M 
replaced  by  M + 1 . 

Steps  7 , 8,  9 similar  to  Steps  2,  3,  5,  f>  except  t fie  computer 

displays  "INPUT  FINAL  CONTOURS"  and  the  final  distribution  is 

sped  fled. 
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Figure  18. 


Operator  Flowchart  for  Sampling  Program 
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B.  Specify  the  Mean  Path 

1.  The  computer  displays  "INPUT  MEAN  PATH"  and  "MOVE  CURSOR." 

2.  Move  the  cursor  to  the  mean  of  the  Initial  distribution. 

3.  Push  "MOVE/DRAW"  and  draw  the  mean  path 

A.  When  the  mean  of  the  final  distribution  is  reached  again 
push  "MOVE/DRAW"  then  "ENTER." 

At  this  time  the  display  goes  blank  while  the  computer  samples  the 
Initial  and  final  distributions.  When  this  process  is  completed  the  display 
returns  with  a yellow  dot  displayed  for  each  sample  in  the  initial  and  final 
distribution. 

t 

C.  Specifying  Interpolation  Point  on  Mean  Path 

1 . Press  "MOVE/DRAW"  and  a cursor  appears  at  the  start  of  the 
mean  path. 

2.  Pressing  any  button  except  "INTERPOLATE"  moves  this  cursor 
along  the  mean  path  one  segment  at  a time. 

3.  When  the  cursor  is  at  the  desired  position,  press  "INTERPOLATE" 
and  an  interpolated  sample  is  created.  The  interpolated  sample 
is  again  displayed  as  a group  of  dots  appropriately  located 
between  the  initial  and  final  distributions. 

A.  Pushing  "INTERPOLATION  RESTART"  restarts  at  Step  C2,  and  button 
"PROGRAM  RESTART"  restarts  the  entire  program. 
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5.0  RESULTS 


The  contour  interpolation  algorithm  and  the  sampling  algorithm 
described  in  Sections  3 and  4 were  programmed  and  several  aspects  of  their 
behavior  studied.  Figures  20  through  22  contain  xerox  copies  of  35mm  color 
photographs  taken  of  the  ID)  Display,  In  Figure  20  we  see  the  contour  Inter- 
polation algorithm  in  operation.  This  figure  is  divided  into  three  parts 
showing  the  initial  (S-shaped)  contour  on  the  left  with  the  terminal  (C- 
shaped)  contour  on  the  right.  The  two  approximately  horizontal  lines  are  the 
designated  transition  boundaries.  Part  A of  the  figure  shows  an  intermediate 
contour  which  has  evolved  to  a point  approximately  1/4  of  the  distance  between 
the  initial  and  terminal  contours.  Parts  B and  C of  the  figure  contain  photo- 
graphs of  the  display  as  the  intermediate  contour  had-  evolved  approximately 
1/2  and  3/4  of  the  way  between  the  initial  and  terminal  contours.  It  is  seen 
that  a more  complex  figure  could  be  constructed  and  evolved  from  segments 
such  as  shown  in  Figure  20,  Also  it  is  important  to  note  that  the  contour 
interpolation  algorithm  has  the  capability  of  evolving  contours  which  exceed 
or  "lap  over"  the  transition  boundaries  as  demonstrated  by  the  terminal  con- 
tour. The  importance  of  this  feature  is  discussed  below. 

In  Figure  21  we  see  the  interpolation  algorithm  being  used  to  uni- 
formly evolve  one  arbitrary  "closed  contour"  into  another  arbitrarily  shaped 
closed  contour.  The  interpolation  algorithm  allows  this  to  be  done  when  the 
transition  boundaries  are  defined  close  together  and  parallel  to  one  another. 
In  this  case  the  separation  of  the  transition  boundaries  has  been  exaggerated 
to  show  that  it  is  still  the  same  algorithm  in  operation.  The  figure  shows 
an  intermediate  contour  at  approximatley  the  half  way  point.  It  is  the  algor- 
ithm In  this  form  which  would  be  used  for  evolving  the  individual  probability 
contours  of  NPPPF's  between  terminating  contours  which  were  either  operator- 
generated or  obtained  through  a statistical  process  such  as  provided  by  the 
sampl ing  algorl thm. 
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In  Figure  22  we  see  the  operation  of  the  sampling  algorithm.  The 
left  hand  and  right  hand  distributions  are  denoted  by  the  solid  contours. 

In  this  case  the  PDF  is  represented  by  two  levels  of  contours--an  external 
contour  and  s single  internal  contour.  The  internal  contour  Is  difficult 
to  see  In  th<  photograph.  However,  Its  location  Is  Identifiable  from  the 
higher  density  cluster  of  sample  dots.  The  line  joining  the  left  and  right 
hand  contours  describes  the  desired  locus  of  the  PDF's  central  tendency. 

The  center  group  of  dots  represent  a statistically  derived  sample  of  the 
intermediate  NPPDF  at  approximat ley  the  half  way  point.  We  note  that  the 
peak  of  this  distribution  has  also  moved  approximat ley  half  way  between  its 
"high  location"  in  the  initial  contour  to  its  "low  location"  in  the  terminal 
contour. 

The  intermediate  NPPDF's  defined  by  the  sample  in  Figure  22  would 
next  be  represented  by  a two  level  closed  contour  which  is  of  the  same 
topological  form  as  the  initial  and  terminal  contours.  Thus  it  is  seen  that 
sampling  algorithms  can  be  used  to  generate  intermediate  NPPDF's  on  a statis- 
tical basis.  At  this  point  the  contour  interpolation  algorithm  would  be 
used  to  produce  the  continuous  or  closely  spaced  NPPDF's  as  the  distribution 
evolves  from  right  to  left.  We  anticipate  that  using  the  interpolation 
algorithm  together  with  the  sampling  algorithm  would  provide  a computationally 
efficient  method  of  obtaining  a continuous  history  of  the  dynamically  evolv- 
ing NPPDF. 
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6.0  CONCLUSIONS  AND  RECOMMENDATIONS 


This  study  has  produced  two  new  algorithms  for  developing  end 
processing  non-parametr »c  probability  distribution  functions  (NPPDF's) 
using  interactive  computer  graphics.  These  methods  appear  to  have  potential 
use  in  future  systems  for  defense  against  swimmer  attack  and  other  military 
command  and  control  system  applications. 

Specifically,  two  algorithms  were  developed.  The  first  is  a fast, 
non-stat i st i cal  method  of  interpolating  generalized  contours  which  is  based 
upon  a "minimum  order  polynomial"  method  of  point-by-point  interpolation. 

It  was  found  that  this  algorithm  is  usable  in  real-time  applications  with 
Interactive  graphics.  This  algorithm  would  find  use  in  generating  the 
intermediate  contours  describing  a continuous  evolution  of  NPPDF's  between 
predesignated  initial  and  terminal  NPPDF's. 

In  order  to  permit  the  interpolation  of  NPPDF's  along  more  complex 
paths,  a second  algorithm  has  been  developed  and  demonstrated  which  will 
generate  a sample  of  points  to  define  the  intermediate  NPPDF.  From  the 
sample,  various  algorithms  con  derive  sufficient  data  to  regenerate  a 
contour-like  description  of  the  intermediate  NPPDF.  The  resulting  NPPDF 
would  then  have  a measure  of  statistical  validity  and  couid  be  used  as  an 
anchor  point  for  generating  the  continuously  evolving  distributions  using 
the  interpolation  algorithm  described  above. 

It  was  also  found  that  current  generalized  techniques  for  estimating 
PDF’s  from  a sample  are  not  sufficiently  fast  for  many  of  the  real-time 
command  and  control  applications  foreseen  for  this  technology.  Two  primary 
v/ays  could  be  used  to  overcome  this  speed  deficiency.  The  first  is  to 
develop  new  and  more  rapid  PDF  estimation  techniques  that  produce  usable 
results  In  the  required  time  frame;  and  second,  a special  PDF  estimation 
processor  appears  feasible  which  could  use  existing  algorithms  and  be 
instrumented  so  as  to  perform  parallel  computations.  Initial  estimates 
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show  that  such  a special-purpose  hardware  us!,'n  microprocessors  could  cut 
down  the  PDF  estimation  time  by  two  orders  of  magnitude  over  those  achieved 
in  computers  performing  sequential  processing. 

In  order  to  continue  the  development  of  these  new  techniques,  we 
recommend  that  the  following  tasks  be  performed.  These  tasks  would  be 
divided  into  two  phases. 

The  first  phase  should  (I)  develop  more  rapid  means  of  generating 
s tat i s t i cally-based , intermediate  PDF's,  and  (2)  evaluate  the  continuous 
evolution  of  PDF's  by  comparison  with  the  evolution  of  parametric  PDF's 
of  known  dynamic  properties  (o.g.,  the  covariance  prediction  equation  of 
the.  Kalman  filter). 

The  next  phase  should  include  a human  factors  experiment  performed 
on  an  interactive  graphics  system  using  tactically  significant  scenarios. 
These  experiments  would  be  designed  and  executed  for  the  purpose  of  testing 
the  ability  of  human  operators  to  (l)  estimate  NPPDF's  from  the  types  of 
data  available  in  realistic  tactical  command  and  control  systems,  and 
(2)  predict  the  predict  the  evolution  of  the  NPPDF's  in  a machine-usable 
form. 
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APPENDIX  A.  CONTOUR  INTERPOLATION  PROGRAM 


t? 

i 

VOPTXII  FTM 

1 

c 

H I ME.  1 £ --  M.  SCHECMTEPMriM  AUG  . 1 

£ 

COMNONRA 1 DPL  < 3500  ) , IEPP 

C 0 M M 0 N / ft  T T s .1 0 T T < J t > 

'i 

0 OMMON/ 0 0 M T r I N Y ( 3 0 0 ) , ANY©  , I C 'J P S 

tr( 

* milts , i start , i>;y  * iv© ' iemd ! ixemo 

6 

C0rir-10M/GRIL>  'PL(c: , 123)  , AR(L\  123) 

i , 
t 

-C  0 r 1 N 0 M P E C T D P 0 C 133)  , SIlSTMf  120) 

F! 

icuRsr  = 1 

§ 

i rise- 2 

10 

I DM  I IS  = 20 

n 

I OF  SCR  5 1 

IE 

ILAMP< 1 ) = 0 

13 

I LAMP  ( 2 ) =2 

14 

ILANP  C 3 ) =4 

15 

I L ftH PC  A ) =3 

IS 

5 

CALL  Giril  1 I DPL  , 2500  , IATT  , TERR' 

17 

CAL  L.  G S E G I C U R 3 R , '?  , 0 ) 

13 

CALL  GEEG  C ItiSG  , 0 , -50  ) 

13 

C 

define  initial  and  final  contours 

20 

IALT=3 

21 

icolor  0=0 

I COl. OR  C 2 ) r 0 

p P 

LOT  = 0 

Ji 

- i 

ISTARTS0 

*5 

i e r i d = 0 

P c 
LrO 

i c 

NX  VO®  1 

P'7 

call  contur 

l-S 

call  a i nit 

re? 

t.alt®  t alt+i 

33 

IP  ' I ALT . EC , 4)  GO  TO  10 

p i 

c 

p EFT ME  TRANSITION  BOUNDARIES 

P TT* 

?:;:o " al  r.  i , i ) 

■ i » 

•J 

IV0® AL ( 2 , 1 ) 

34 

IXCMD® AR< 1,1) 

35 

I VEND  = A P ( 2 , 1 ) 

pt  p. 

■>'  f~-  ’ on  ^ ^ 

" 0305  C 7 ;■  ■■  i 

p -3 

’ V T*  ■ i 

J. 

3 ?■ 

I r'  T * ~ 2 

4 i 

\y 

nlW  = l 

7 £-■ 

CALL  CON" UP 

45 

CALI,  ft  IN  IT 

~ s* 

INOOLC 1 .120) 

4 5 

■'  ■'  :LI  >'  p 1 *T-  O *» 

4 G 

T V r \ ! ^ - y 7 ( 1 ; i 

4 7* 

r M fi  ^ r~>  r'  “ • 1 O '~i  T 

5 

1 ft  L.  T = I ALT-*- 1 

4 S 

IF  1. 1 ALT  , LQ  . 6 ) GO  TO  EO 

50 

CALL  PLOT IL 

L~  -1 
•J 

ROLL  MJlinijT 

tr  c:f 

-_j  i— • 

call  glnp< i , -i , e ) 

tr,  ■'p 

0 O T 0 s 

iv (G)  (I -a 00  lours 

q 7 7 


R , I MSG , I COLOR? 5) , L5T . I ALT , IL 
, IYEMD  I Of SCR 

. B ( 2 , 1 23 ) AU <2,129) ,AP(2, 129 
, C05THC 123) 


5 4 F N 0 

ERRORS  coni-  ELATION  complete 


this  page  IS  best  quality  PRACXIOABUI 
JHOil  OdTY  WiUiSHED  TO  DDC  — — »■" 

-48- 


AT1PC4) 
) , HELP 


-50- 


■t-V,!- 


3,3 

• i 

p i 

■J 

1 

3 iv 


0:  m 
■1  0 
;> 

. 1 -N 
.1 

1 .* 


V 0 K T >:  1 I UTN 


f.uPPOuriNi'  i-’ccru. 

roilM-ir-!  .'GP'.'  D 01.  i U ( Ipg  ) ? ..  PC  <’  , 

’i  i I \ 1 , ‘ ' f IT!  I ( 1 1 . ■ 1 ! I • 1 .00  ) 

I’f ! I.IOGTMs,  siU:S,  I'llP  i .'O'  i j ft  t 
N.i;  OOP  C GO  1 HI.  O'  Till.. 'I'll  - 1 1 


0001  HO!.!  10 

i or- ) iiiu  z , i <;•! ) , on  ,J , i r:n ) , pt.uu 


c 

OM’-IOH 

o' 

irr 

C coil 

'01  l 

V!' 

1 t 

■:  J . r 

. . ! -. " 

HO 

? > 

» J 

-M 

t , 

no  oO 

1 ■■ 

1. 

, 1 

v 

n 

- o>  i ■: 

1 , 

1 

1 

o 

• 00  I 

* > 

i 

) 

'-3 

n 

'0  • 1 ’ 

fc30T.yr 

1 0 

’■j 

l.MTH  c 

1 1 

- 

ir-; 

1 t. 

A 

00' TO  1 

i ? 

PY 

1.  n 

30  C 

orn  in 

or 

1 A 

' o ••  o p 

i i 

! 

1 > 

1 '1 

V 

1 ‘O  •i'll’ 

|.  0 

f 

1 ’ 

1 C 

V 
. \ 

pri  -iii) 

t 

in 

1C 

V 

: ■’  o *•  o !< 

i , > 

1 1’ 

1 •? 

M 

o 1 o o 

1 

j 

ir-* 

C PH! 

1 T 0!. 

0 

f 

p 

13 

v 

1 'OL  '• 

1 . 

1 

i',3 

Y 

!.  t:0L.  < 

J 

> ■ 

i!  1 

y 

lO-00  ( 

1 

*'■  ; 

1 

i •• 

Y,;P  GO'.  o.l’  YUM 

no  tot:.:  o',.. ' ohp  on.  utuutum  r,o  _ nn  to  sTroiGHTCf.  out  on 


m.o: 

i 1 3 *..♦  '•  1 

i;o-;-.TOi  ’ 

iV . c 

r*  1 3 V 3 

!0 ; utiu;  1 

»:>!•.'  i. 

• ' i 1 

( 1 ; i : , T 1 1 !.  I 

r:»  r 

3.1’  - c >: 

0!  niUTUc 

r;  ljr-1 

JJ w 

r T HU! ; 

> our  no 

U1  P.'A’h 

o h:1"1  u ’ i;.i i v on:-:”  p, ; pp  m ms  i*  nt  oou!  o h.!'  oil!;  ropTO.  i„!- ngi  n sr.oTi  h rs 


n . • i .i 

1 1 • : " ISO  1-1.1 

:n>:V!c  i.tij’  -oh  ' a . n 

n . i -■■  i.  ’ l it-:  ■.  u , i ’ 
ii  iToot i p ;;i  ;n;j  nvuTv 1 
1T0  '.'Oil !'  ’ I !' 

ui.lvp. 
n o o 
J ' 0 

i"'  too  ] '••;■.  iro 


pi : v: * xt ii i in::  l 

ii  i !■  p":y ; i ; o TO  TOP 


sou 


’ r-  o 


i , 


,!•:  • t . J > 

■ .!■■■ : i -hi 1 ■ o 5 ■ 

■ i\T * nv» 

i , i to;;  ■ o r>i  ooo 

nito  n;.ov:  vu  :•  ■:'V;V!  ’ 

' I I * i 


1 ; -i 


SI.;. 

' 1 , 


n ■ 1 ’ i ■ v'.'iv  i ; "’.oi 
i:  I ’ . 1 ' 'S'O  O'!  T T !.  "’(’■!  i’V 
?;'0  i 0!  I V > H’  I! 

no  i -o  ,i  .:o 

01'  !.  IV  ]'  I J J 1 

i-;”  i.  •:  ’ 1 1 p i,  •; , l.  i 
opo  i'  >..  i : •; ; v|.M!!: 

I ■ ■ 'v  ’ ! ! 

OOP 

'no:'-.'  ops:  lOiViOH  0o;!0:..’  ri. 


,>  & 


/' 


0/ 


A 


-51- 


1 


VOPTX  1 ) 


r-  rr  ; i v c c, ) 


oooi  HOu?r. 


I 


POO!- 


1 

1 

I 

! 


* 

P.'JI  POU  X II'IP  I'l  J.  MOU  T 

L 

00!  ’PC! ! •' * l T T ■'  I hT 

r 1. 1 c 

C’PO  JP  'OP.!  ” '■ »: . 

i : . : . 

■i 

r or-;:  !■'.'■■'  ' L C ■ 1'P 

3 . 1 . 

i poor  r.1*  i 

M.i.'..  O'. nr 

1 '• 

rm,:.  mpifc  i in 

i i 

< . 

coll  gi.wi'*  i , i 

‘ i i 

1 e 

r.o>  ! . r.pp  n i v n _ 

cl1  ■ 

i 

CRlV’  V’UTClV  1 1' 

10  , c 

i '' 

.■>  t. 

j r;.>  T ^ 1 . ' 

3 

0 (V..0  " OOVT  f O ' 

i t 

1 ATT f 1 ' -0 

ip 

OR!.!.,  uPTT(P.P) 

10 

C R Pl'T  '-V’-::. ' J 

! *7 

I !■  L V 

J.  «*• 

: v - r ii.ii 

i v ■-  : '!  o: , i i 

i ! *.* 

Oil!,1.  C-.PUT':  TPL, , 

i -.J  , 

o1 

111.  I ! L,  •!-  I. 

■ > 

DO  p O''  Kir 

■»  ■% 

1 >•  1 T.  '1  1 ' 1 ) 

i * '■ 

i v -v.  c p ! i • 

i 

f-P.'-L  IP l , , 

r ^ ms 

ulj 

! t* ! . ' 1 1 

, * • 1 
l » ■ 

POO  C'.'I'O1  .’  1 •".!  !; 

'1  •_• 

• 'pi..1 . 

7 ■ j 

. *. 

p •>  ' ' mo',".:  : i , 

L( 

;-•)  j 

i ,-ji  t<  i m 

3v 

i i V i :irr , i . m. 

. .;)G 

1 ! < t ftTT  1 J ' . XX 

. 3 1 

C ” 

i ■:  jo ptc . pi 

, 4 ■/ 

7 . 

i !’  • j h ’’  r i,  i . Ip 

. 13 

;i , , 

j i .TpO'JNl’  . f O' 

3 % 

■' o0"J ' !r'  ■■  0 

3' • 

t.  ro.’.i  . Y.pi.”  ci" 

j 

0 i-'v..!. . I'/pn:  i.  ij  i 

•P.  ■ 

r, i' i jo 

•i : 

ipoi.nt.--i 

i ■ ,,J ) , r>!- ■: r , ",  - s ' . I- 1 £ , i i’?  ) . O'J r £ , .1 

. v ) i ; ; v ! •!  ( i ;•  c o 1 • i M ' J V\Vi 


?VJ  f 


r-gi , p!::lp 


■ N .IV) 


■ -r  T j;  ^ > jv < - i ) Q *3  7 n 7 v 7 


1 P ! N 


r, 


>•  i >!•!  : 1 


, i . : ; 1 • 

. 1 


7 Tv 


• “ * * * i , ; j > ^ ":  > 

vOr  "'/p 
PC  ' C ‘VS 

1 Jl  ' • * 

f i ‘ V.  ■ ..  v‘  ( r»  1 
^ ; ‘ , }‘  mjv;  •[  <*  } 

! i ’!  0 . / i' "J 

t oLJ  I : !Th‘i',‘* 

.1 ! f I «':TT  i j . NC  . OP  . 1 MTT  < ? > . Mb'.  . T S ) Gn  TO  g'Jf? 

If  v 1 i ■ ’’T  l 'i  • . 1 -)  , o J 0*0  >VC 

t 'T  1 I ‘Ml. 
i j;i  • ’T. 1 !’  ■».; 
iv  ’•'»  1 W 


i • 'll  » i^i" 


i»ii  . r 


■■r  r >i  1 1 1 t X ICAB^ 

“52“ 


VOHTXJ  1 


CO  PC 


sou  ■?? 


I 

I 

l 

l ) 

1 

1 ^ • 
MV 


V'  !j ' ' s>  o { ! • j nj  i ; !.  i p . 'TV , * j > 
r ^ ; : !j  >■ i '**  • ■ m *.  i ■ ; \i ) 
.• , , ' i_  T 'L*;-V  ; ; i ; v : 
i . . = i : ’ .>  - 1 ••  o /j 


C IN  ’ V> 'T.'ViT  . POY 


■ ; N * } 

“l  1 J. 


v-  * »;  i ; ? iv; . -tj  '•‘J-kl  ; : - 

U!s'1  '0’ViVrr  ft!*.1  V •,0V-  ‘“O  * jV 
” ' ’-i  1 . 1 %;  = NTTV’:  ; * vV/  ~r.y 


5 ^0  C-OM’i  " - ! M !f; 

:<■.  T i ! ! ' N 
4 ! ') 

$ !.  r;.‘  ft 0 ' ; c O " * : ! r ■ T <*«  ; 0 N 0 !’ ! r ’* L --  IT. 

• ; i.  s 

ttum,  :-‘v . i-; 

:-j  . i.  c 

f;  ; i ; k »* 


tfRoU  VjVI‘ 


■5*»- 


VOI-'TV  1 l 


r T'H  IV  CC. ' 


vooa  HC’U 


f.M  I _ ^rinf  I l ni-1-  | ’!•'  O O' 

A inMj'*;  i.;;vjT'.''\  l!N  !.TS  L.Or:G 

V ^L' r k t r.!.  , 0 , o > 

' v ' I T('- 
> » > w « . ■■> 

■ ■ v . ] I • “ n .*•' 

■*  ‘ *7 » y •-  !?  t £ t ;>  r ; p _ pvi>v.vT  , NO  , r* ) 00  *:‘0  -100 


% • \ 

0 vorT  vo 

' V' 

1 1 - * . j.  -« 

\ - * «.  rr : v , *Yr  . SCO  ? 00  TO  S?C-0C 

1 V,  • . K>  • • V • ^ ^ S • 

T Wi  r',v  * ■ I Y 
r !*s  r ■ o * ' *-‘j  1 ; ^ o ^ i * T J C 0 1, 0 1 1 ; 0 

l ::  \ • r: fv*M  , V'  0 . 0-\ . 1 ■ ' 'r !'i  , N 0 , 0 ' 00  TO  0 07! 

T »•>  r s »•*  f.t  p ...  1 VI 

? OS’  • T VI:  N?“  1 VL 

00  v0  VO./ 

? y-N  • ; y •-  - v !_ 

} y\  - ’ s“  - ; yw 

> i ».  • ..  i i>  \ • 

' a 1 • ' 

i !■;  ».  **  MV 

0,  - '.I  'sjv.: j.^yr ny 
} «’  - fW.  , 0,‘-  , > GOTO  •% * •»  ■> 

1 • •;  :i : ; v ? a o 0 ' • o ' r o ? o 0 o 

• ‘ m *; ' t 0 V V O l * ’ ’ r \ \) ! ’ f- % 0 ° 7.  M T 0 1 .N : Y 0 ! j o y 

■*  'V*  i ‘vV  V > . 

: ■'  v » i'i’yy  * \ s.  -ooco 
nov ‘O-’SV't; 

■0\  o 

l . ' V . M 

C.  0 Tv  c< 


• i,  n j r OOOOl’Or 
C \ •'  y v\'  I . . 

■ ‘fp  .u  V- " N * ; n‘.  r > 

OOJ...I  iV'L’T  . .1  t L , bO  ; J.  ,SN  . 1 0^'  > 

j •“ ' ' " ? * O ! ‘ 


! »•  vV  iN. v vV'^  *'*'VvO  0000 

• !■  1 M-  ! I..’  V*  . M...  . 1 !'  I ?-0;  . y y I*i  V 0 l:0r> 

<-•  t > ..  T K }.  »..!  . 


THIS  I'AGE  IS  t'EST  QUALITY  FKA.CX1CAW*- 
FROM  00a  'i  /n<u»J.oiu!A-'  10  OPC 


I 


i C'AC-.!i  i 


T I \'  P , M X »1  f;  1 P , P. , o 

in  r«  n *'* 


* ! ■-0  i i'-t  ' .■  • 

I v;: .»  5 -iov 2 
L V « l'i  I S P p 6 5 0 5 3 
V.VTVh  0 63171 
v:cdw  p Vo 

I " c T l’i' 0 H H 7 00H 
S CTDOD  f'l  75570 
’**  S-3PCB  O 77P-42 
GOKCB  P 7?£S4 
I-  V#[05T  P 74733 
f POP'f.0  P 7 7 06  6 
• . v u • i P £ H R 3 J 6 3 7 

i"vMv.  I 3 

•»IV  r 


v 

C-  [ ■ I 


I 

I 

[ 

l 


! 


| 

I 

I 


’ 7 r’ 

p 

n *%•  i -«j 

I .. o *i  r'  tr 
\ , ■ *-•  i 

yy'v.ib 

VF7  7 

)\ 

c 

7*.  ' IS 

<!  -. 

P • ■ 1 1 -i 

* 1 

V^r" 

' l 

v,.r  M.'ib 

v . - 

: 1 

' v"1  l . 

vu:V.rp 

n 

* 

• » ‘ ■ 1 »’ 

i , ■ 1 1 

! . ' ! 

l’i 

C . - • . • 1 

! DO  3 J 

r j i • 

[ •<  V -i  -l  1 

! • *. 

1 • • O ; » 

ft 

c \ * ■ " “* 

t • . i . < 

^ 1 1 

4-.  f#:  4 _»  •; 

V -'.yj"  •: 

7- 

\ ! ■!»  ’1  • 

■vr* 

, • * • 

*•  ' ' 1 ! * 1 

. ' t * ' 4 

s.'7'i.'P 

DIG  PI 

o 

pr.i)fin 

V 7. so  p i’ 

0 I.O! '3-1 

V *1  Vi  TUP 

ID I ! Oi’l 

H 

G 3 l 6 i2 

I PI  OOP 

n ..  p.’vo 

S' PM  I'M 

ii 

D-  i . b 

T I DP DC 

A 

7606  1 

T I I'D  J P 

tl  703.37 

CTT70P 

A 

7 * . 3 •.  1 1 

C IP TO m 

1 1 

VSVoV 

01  U-'OI: 

f V'lbbi' 

• /Til  i'i.'i  > 

? 1 • -?  .*« 

r;TldCf! 

P 

V if*  c!  ^3 

V 11  ' J L "3 

6 7 6.360 

V iH'.iCb!'. 

n 

< L'  4 is 

SI  FOB 

ft 

y.'  160 

PI  FOB 

P 7 7.!  70 

I.OF  Ob 

H 

7 7 3 0 4 

BOFCB 

l’i 

71*330 

BlFCB 

h 77316 

V1RFPF 

R 

3SA  SO 

V#IOO 

ii 

7 3 OP  l 

v its  >:f  c 

A 7 1-12-1 

V IDSTJ3 

0 

b -4133 

*E.e: 

H 

-1  3 6 b 5 

nix 

K :i  6 0 1 .1 

VIS'D  MB 

P 

f: 

:j.  i o o 

3!:.’’':dF 

\/nr  I 11 

»«’ 

» 4 .1  i S 

* •’  L.'.'P 

P -1  6 

f-"..  '■< 

1-  < r 

{ > 

• ■ t 

.*  i ' ' 

.*  ’ 1 

‘ ’ . *,• 

«».  1 * 

4 ■ 

« ...  -I--. 

«•  ■ % 

'•  * • 

■ v ■ 7 

* ■ , ■ . ' 

T (’  l 

*■  1 

i ; . 

•.r  r. , 

!;  ’ ‘ ».•  [.> 

3 i os  !■• 

i 

— t 

"*%  • - ■ <> 

1 1 

».  ! ' . ' « 

L * '•  * 

v.  .. 

■ 

r.  ■ ■ ’ 

**»  . | 

i , • • * 

:*i  • , . • 

i* , *,  .“'V 

, . 

‘ . " T 

N « ' ' 

' • O ': 

-i  < i * '• 

* i ■ 

D. 

. 1 * 

,*  ' r 

V ' • \ ' ■ 

' ■ 

.4  * • ’ ‘ 

■»'  •**  r.' ' ; . ;• 
•?*!** 

■ t 

,i  **  i t 

' , * ' • , 1 

\ •* 

• \ • • 

V • 

, . *i 

\ ■ ' ■ . • 

r.  ■ 

• 

' , • :• 

- ’ ! 

, "*  « 1.  . ' 

• , • i 1 , 

; • V 

. , - V 

, . 

. • 'T*  , 

*•...* 

• •**.  ■ ' 1 

• 

> 

. * 

f'l  • : *; 

* 

r’;  .i  ; • 7 

'i  • , • ■ 

* . . ' ' * * 

1 ’ . , ! * 

• » » 

r . . * i , 


THIS  PAO£  IS  BEST  QUALITY  PKACX1.6MA* 
JWNI  OQTY  JTUfULlsiiffl)  IV  DpQ  1.. 


-60- 


APPENDIX  B.  SAMPLING  PROGRAM 


PAGE 


l nirur.ii  vortxii  etn  iv(g>  0009  hours  | 

C.’r***^**.t#-t***.*t:iM: 1 Xt&*  itt*******#*] 

c runt  n-is  julv  if??  I 


COMMON  -'D Ml' DHL  ( COCO  ) . TERR 
COMMON  ,'ATT-IATTt  12? 

COMMON  /MXME£-'NCMTUR.  HROtCCS)  . MRIFC  ( b . 3 ) ,NIXY<5. 

i xrti n ( 2 ) , i x m a x < c ) . i vn i h ; ?.  ? . i ynax  < e 

COMMON  /COflUM  'NOVPTR  . NNUVLY  ( 20  1 . I F LOG  C 20  ) 


NRFATN  , N I PATH , 


COMMON  /COMUM-fS 
COMMON  /CCNTIJR  - 
COMMON  /SAN '1 5 1 
COMMON  /DISK/ IF 
COMMON  /MISS  'ME 
INTEGER  OVLYNMC 


DATA 
DOTS, 
DOT  A 
DOTH 
DATA 
CALL 
CALL- 
CALL 
CALL 
CALL 
CALL 


/ C C N TUR ■ NXY . I X Y l 8 C 0.1 C 0 1 , 0 R V 2 ? 
/SAN/ IS  l 2.  100.3?  , NK5.3? 

/DISK/ IF  C1U  13? 

/MISS /NFS 
OVLYNMC  3,  *1 1 

LYNN (1.1?, CVLVNN i£,l?, CVLYNN C ' 


LST , TO UR SR, I ALT  , IN 30 


CVLYNN (1,1?, 
OVt.YNN ' 1,2?, 
OVLYNMC 1,3?, 
OVLYNMC  1,-1?, 
KF.VMA.KVT/ 

V IF  OPEN  C IS  , U. 


t,  vuin i i v .. 
CVLYNN  r 2 
CVLYNN ( 2 


CVLYNN (3 , 
CVLYNN i 3 
CVLYNN i 3 
OVLYNMC 3 


'SHIN, 
'2NC0 
'2HSA  , 


3KPU , 
2HNT 
2HNP , 

shne 


2HT  - 
2H2  - 
RULE 
SHOO 


•J  { 
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w j.  . i.,  i 

NNOVL 

•s  GO 

NOV!'  TP 

3? 

GO  TO 

TO 

993 

UR  ITS C 

41 

GO  TO 

4 2. 

1000 

r CRN AT 

43 

1001 

FORMAT 

4 4 

END 

CALL  V IF  OPEN  C IS  . IG  . I PCD  . 0? 

CALL  GIMICirPL. S0CP.1ATT, IEPR? 
CALL  GBEGC 1 , ICC . 1023 ? 

CALL  GCNAC  1,6,  0 , 3 . 7 ? 

CALL  GPUTCC, 1750.3, 1 ) 

CALL  1 7,07  ( 1 F LAG  , 20 . 0 ? 

WRITE! IF  . 1000) 

CALL  05 TT (0,0) 

KEY=1 

IF  ( K E Y . G T , K E Y M A X ) G 0 T 0 5 7 0 
CAL!,  OYLAY  C 0 . 0 . CVLYNN  v 1 , K EY  ? 
NOVPTR- NOVPTR-}- 1 
KEYU'IMOVLYCNOYPTR) 

IF(KEY.GT.O)  GO  TC  30 
IFCKFY.EQ.O?  GO  TC  10 
IS  NEGATIVE  FOR  LOOPS 
NflOVLY -4  5 , 6 , - 2 LOCKS  L I ME  NN0V1 


■HMINE  II) 

1 ERROR-OVERLAY  NUMBER*  TOO  LAR.1E"  <? 


CROPS  COnPlLATION  COMPLETE 


page 


1 c 

E C 


MIME  II  VOfv'TXll  f-;  m XV(G) 


POOP  HOU IS 


BLOCK  DATA 

c o m o n / d i s ;< "■  i r c b U3> 

pqm  ifcbc3i  . i f cu r x' ? , ifcbis)  . ircuao)  '9,ehti,£h  ,sh 


* b END 

0 ERRORS  COMF1  LATIOM  COMPLETE 

r/UEOF.m 
/MEM, 6 

•,  /FORT  , M,  H,  F 
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vi 
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i 3 
1 *■? 
15 
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'O  o 
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43 

451 

50 
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S3 

c-  o 


55 

CT 

O t_i 

C '» 

55 
50 
0 0 
5 1 
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,T  - 1 PPL  C SCCO  ) . IF. PR 
.'M I ME  2/NCNTI3R  . FR0BCC5)  , MR  I PC  l 5 
iXMimai , ixnnxa.i , iynin 
mCOUUN/MOYF  IF: , MUOYLY  ( 20 ) . If  LAG 
-'CO  1ST  UR  -NXY  , I XV  C 300  > , IC  01. OR  C 3 ) 
.-•  D15K/IF  C1U  1 31 
/I".  1 OS ''MR 3 

EQUIVALENCE  ( I CUTUP  , I FLAG  r 2 .) 

1 ( IELMC , IF  LAG (51 ) 

IlATA  MAXTUR/5/ 

CALL  GHLT 
WRITE ( 5 . 4C40 ) 

4040  FORMAT  ( ' LIST  FRED  INPUT') 

IF ( I FLAG  1 1 ? . FQ  . 1 ) GO  TO  ISO 


COMMOM 
COM MOM 

COMMOM 

COMMOM 

COMMOM 

COMMOM 


3)  4 NIXY I 5 . 3) , NRPATH , N IPATH, 
.2) . IVNAXC2) 

20  1 

LET.  1 CURSR  , I ALT  . IM  3G 


1 . 1 I Fl.MA  , IF1.AG  ( 3 1 1 , ( IF.LMB  . I FLAG  ( 4 ) 1 
. C I ELMD  , ILL  AG  l 6 ) 1 . ( I El.  ME  , IFl.AGC?)  ) 


IF  C IF  LAG ( 1 ) .EO  . -1  ) 
IFl I FLAG ( 1 i .EG . -2) 
CALL  T 2 A F ( I X M I M . 2 
CALL  IZAPCIXMAN.2 
CALL  I ZAP ( I YM I N , 2 
CALL  I ZAP ( I YMAX . 2 
I FLAG l 1 1=1 

I 0 U R 5 R = 3 
I MEG  * 4 
I ALT  = 4 

DEFINE  CURSOR 

CALL  GBEGCICUR5R. 
CALL  GPLITfe.73.0. 
CALL  GPUTC7, 1600, 


GO  TO 
GO  TO 
ROOO.i 
0 ) 

20001 

0) 


,0 

10 


c 


CALL 

CALL 


GRUTC 


.500 


0,0) 

0 ) 

3,0) 
5 O) 


GEOF ( I CURSE  1 


SO 


’ I UE  MESSAGE  AREA 
CALL  CF:  E G f I H S G , ? 0 0.0) 
CALL  GCHA ( I HSG ,5,0,2, 
CALL  GBEG  f 2 , O , 0 I 
CALL  GEOF Cl  MSG  1 
I l . M " 5 
CALL  GHLT 
I ELM A - 1 ELM 

CALL  SE.TUFU  (2,1  ELM  , O . 
WRITE! IS. 1000) 

CALL  SETUP W l £ , 1ELM, 0 
WRITE ( 15, 1001 ) 

I ELNF  = 1 ELM 
I ELM  = IELMB 
CALL  SETU 


0 


u.  . 


lo , r 


i 


GT 


1 ELM  , 1 
MCMT'JR 
U! 


GO  TO  SO 


100 


150 


IF (NC NT UR 
MOVPTR  = 0 
MMOVLS'  ( 1)=?. 

NNCVLY  (.  2 ) = 1 
tlNOVLY*,  3)  --  1 
I CMTUR  ~ 0 
I!  LMV'-IELM 
I ELM r IELMC 
I CMTUR  * ICMTUR+ 1 
I ALT  - I ALT  + 1 
CALL  5ETUPU  C 2 . 1 ELM . 0 
W K 1 T E (1 5 , 1 0 0 2 ) I C MTU  R 
I ELMD - I ELM 

CALL,  SETUP:.:  • 2 , I ELM  . 12  . £ ) 
READ  115. 200 1 ) FROBC ( I CMTUR ) 

7 i-*  i r.i  w ~ *t  i:  i m 

CALL"  5 E TUFV  ( 2 , I.FLM  , 0 , -SO  , l 4 
WET TE l]5, 1003)  I CMTUR 
RETURN 

MIXYC I CMTUR  \ ) - MXY 
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If  OVERLAY  COM  TO 
I 0.  T.  t t I t T T X T T 1 S'  1 1 T 1. 1 

Ml J CLOUT  J ML  CANTR 
COMMOli  /ATI  M ATT  C IP) 
COM  MO  M -COMl  nr-’/riXV  , 1 NY 
CALL  GHLT 
I.IR  ITT  ' N , -10-10  T 

•1  c *1 0 !'■  0 P M I'l  T ( ' L M IT  K E 1.'  C 0 H T 
CAM.  GEOTH  I CUM  SR  > 

CAM.  Cl  CM  v 1 MAG  1 


r MOO  ? , 3 COLOR. ' R > , LSI , I CUR5R  , T ALT , IM3G 


c. 

c 


DLL  IN L S I J 11 J L C T C-  0 N T 0 L R S 
CALL  I iI.1T: G ( TAl.1,0  . U 
CALL  lHLc;  (,3,1  30 , 1 , LOT  3 
C ALL  GPUT  (-1,1  TO  , S , l CO!  .OX  (ITT 


CALL  C PUT C T . 1 TO 


r, , 1 COL. OK  (.-1) 

All.1  IM  CONTOURS. 


C ALLOW  SUHJECT  1 J 1.' 

390  CONT  HTML 

C MXY  31.1  UUCP  T PT  TOR  I NY 

MXY-  1 

C IFTRl  - ' FTR  TO  STARTING 
IFTRl  Ml 
lXP=-0 
IYP-0 

ia:mo 
i ay-o 

ILlOMC 

CALL  GCYTM) 

C MOV!'.  CURSOR  TO  START  POSITION 
303  CALL  GT.'ONt:  I MSG) 

CALL  uSCHi  1 MSG , 5) 

UK  IT!  ( IS,  3 O'M 

3 07  V 0 K M A T ( ' M 0 V F.  CUPS  C R ' ) 

CAl.L  01. MP  ( 1,0.1) 

TIT  ILL  . TO  . IS  1 GOTO  303 
CAM.  CL, MR  I .1 , 3 , 1 ) 

1F(  TPTR  1 .ML  . OGAM  C.LMR1  1 , 
CALL  Gi  TIP  I 1 . PA,  1 ) 

308  CALL  TRACI!  1H  1.X,  TV) 

IT ( I ATT ( 1 ) ,NL .301  GOTO 


FLF.ni-.lTT  TOR  CURRENT  CONTOUR 


■ISO 
0 1 GOTO  POP. 

0 ) GOTO  SCO 
i’S>  i GOTO  3 TA 
PC 'GO TO  PM 
SKiCTO  30  7. 


I PC  I ATT  I 5 i . ML 
IF  I I AT  TUI  IP 
IF' I I ATT  ( 3 ) . Y Q 
HT  I ATT  I 31  . T'U 
3T  'C 1ATT I 3 ) .ME 
IF  I ILL. "A  i 3 OP. , 308 , 730 
3 '16  1 FT  IP  T R I . F.  0 . 0 ) G 0 T C 3 0 3 

: ERASE  LAST  CONTOUR 

CALL  GENT (I  ALT' 

; ITT,  NAY  IT  A VECTOR  ! IT. 3 
A 0 3 -IP.  I J * 1 PTR  1 , ILL 
34S  CALL  UP NT (13. 73 . 0 , 0 ) 

I EL  * I PTR  1 
IF’TRJ  -0 
n:\yuptrc 

CAM,  Gl.riPU 
I AX -•■LAX 
I AY  T. AY 
1 XP'-LP.M 
j YI’  -'l  \ ' [ ■' 

I IT  ILL  .ML  .6)  GOTO  30 
CA!  I M.MPM  S 0) 

'.AM.  CM  IP  ■ J,  , II 6 , 0 1 
GOTO  P)3 

I IRA  ST  niRRi.NT 


THAN 


K . U . 


’Si , 0 ? 


3so  ir  ( ; f i. . to  . r- 
CAl.L  GMT!'  i.  1 


TL T IT  UI  t 

H.llTO  ;.['c 
, 0 1 
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a NINEII  VORTXII  FT N IV  (G) 

CALL  GLMP (1,25,0) 

CALL  GLMP (1,26.0) 

CALL  GENT  1 1 ALT ) 

; I EL  MAY  EE  A VECTOR  LESS  THAN  EC  R.U. 

DO  3S2  1 .1  = 6,  TEL 
352  CALL  GPUT (I J. 73, 0,0) 

GOTO  230 

J IXP.IYP  --  LAST  POINT  ON  PREVIOUS  CONTOUR 
: IXF , IYF  — START  POSITION  OF  CURRENT  CONTOUR 


0010  HOURS 


--  LFC 


FOSITIOH  OF  CURRENT  CONTOUR 


C UPDATE  CURSOR  POSITION 
•450  CALL  GENT  ( ICUPSP ) 

CALL  GPUT ( 6 , 73 , IX, IV) 

GOTO  308 

C START  CONTOUR 
500  CALL  GSCH ( I MSG , 5 ) 

WRITE ( 15, 502) 

502  FORMAT  C ' DRAW  CONTOUR ' ) 

CALL  GLMP ( I , S, 0) 

CALL  GLMP (1,25,0) 

CALL  GLMP (1,26,0) 

CALL  GENT (I ALT) 

I XL = IX 
I Y L = I Y 

C ATTACH  START  POINT  TO  VERTICAL  EDGES  IF  CLOSE  ENOUGH 
I F 1 1 0 00- 1 XL . LE . 30 ) I XL  = 1 000 
IF  ( I XL  . LE  . 30  ) 1 XL1-  - 1 

C I AX, I AY  — USED  TO  REPOSITION  EE AM  TO  WHERE  CURSOR  I 

C SUBJECT  CONTOUR  AND  CURSOR  POSITION  WON'T 

IDX  = IXL-IXP-!-  IAX 


SDR  IS;  OTHERWISE 
WON'T  NATCH, 


I D V = I Y L - 


'P+  I A V 


CALL  GPUT ( IEL , 73 , IDX, IDY) 

IXF  = I XL 
IYF  = IYL 
IPTftl = IEL 

IPTR2  PTR  TO  START  OF  CURRENT 
IPTR2  = NXY 
IEL* IEL+ 1 

IF (NXY , GT . 590 ) GOTO  3000 
I XV ( NXY ) * I XL 
I XV ( NXY +1 ) = I YL 
NXY = NXY +2 

.0  CALL  TRACK, B(  IX,  IY) 


•NTOUR  IN  IXY 


IF  ( I ATT ( 1) , ME. 36) GOTO 
IFQATTC5)  . NE  , 0 ) GOTO  E 
IF ( I ATT ( 3 ) . HE . 0 ) GOTO  E 
END  CONTOUR 
50  CONTINUE 

I F ( T E L- 1 PTR 1 , NE . 1 ) GOT 
IF  NO  VECTOR  DRAWN,  GO  B 
CALL  GENT (I ALT) 

CALL  GPIJT  CIFTR1, 73,0, 
IEL  MAY  BF.  A VECTOR  LESS 


DGOTO  551 

GO  BACK  TO  MOVE  CURSOR. 
73,0,0) 

LESS  THAN  20  R.U, 


123 

CALL  GPUT ( 

124 

IFL--IPTR1 

125 

IPTR1 =0 

126 

NXY  ••  I FT  RE 

127 

GOTO  305 

1 Pr‘. 

551  CONTINUE 

12r-l 

J G 0 r 2 

3 30 

GOTO  680 

1 3 3. 

549  IDX  - IXF--IX 

132 

l D Y = IYF -IV 

1 3 3 

DX  = 1 DX 

1 34 

BY -IDY 

135 

D S = D Y.  D X + D 

136 

1 f f.  OS  . LT  . Y 
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MINk II 


V OR TXT I 


f'TN  I V ( G ) 


CO  I Q HOURS 


ATTACH  OPEN  CURVE  TO  A VI. PT  i CAL  SCREEN  EDGE  IP  CLOSE  ENOUGH 
1 1 C 1. 0 00  - I XI . . 6 T .30)  GO  T 0 EG  3 
IJ--1000 
GOTO 


.4  ^ 

‘i  J. 

5 Li 3 .IF  <1X1 

. GT.  30) GOTO  L.5-1 

A ^ 

I J --  - .! 

LG?  CPU.  0, 

F.MH  l ALT  i 
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**? 

I XY ( MX 

YU)  = 1XY(NX.Y“1) 

'■  • '-.x. 

»•? 

> . ..* 

IS XV : IP 

S'  l ?. 

. ; * ■ t 

■ ' ' ••  ‘-v  \ 

j. 

I XL- II 

50 

I EL  - 1 r- 

L-H 

51 

551  1PCMXY 

.GT  .5:00)  GOTO  5000 

\ 

f 7> 

C UR I TE  PHD 

OF  CONTOUR  OM TO  OUTPUT 

FILL  , . 

' ■:  . 1 

53 

I XV ( MX 

Y ) «£P0O 

5 1 

I XV < MX 

YU  ) --P.OCO 

f 

IOC 

MXY”  MXY-i  L 

As 

GOTO  5 

r~  r' 
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comt  i nut: 

COLL.  GENT  ( IA1.  . ) 

COLL  GP LIT  C ILL  , 53  , I DX , T OV  ) 
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LAX” i OX 
LAY-- 1 AY 


If  3 

IAX--IDN 

1 G 1 

IAY----IDY  •• 

' 1 ■ • , . ' . 1 

i 

1 F ( MMV  + S . GT , BOO ) C.C TO  5000  ; 
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INYU'IXY > = 1 XL 

f 

j O'? 

I XY  < MXY  -i  1 ) - I YE 

1 0 3 

IXYUIXYFP)  ---£000 

, - j 

K7 

IXYUIXYS  3>  * 3.000 

i 

17V 

MXY -MXV +1 

\ 

1 ? 1 

GOTO  5.56 

1 ^ 
a « ... 

SS5  LAX  - I AX 

V 

17  3 

LAY  -•■  1 AY 

I'M 

1 A X ’ 0 

1 75 

1 AY”0 

t l 

176 

556  l.NP-IXF 

- 

1.  V 

L.S'P  1 IYP 

178 

i:;p-  r:a. 

1 7 0 

1 VP  - 1 YL 

ISA 

GOTO  305 

1S1 

C UPDATE  CURSOR  POSITION 

1 7 X 

060  CALL  GLUT < I CURSE ) 

17  3 

CALL  GLUT (6,73, IX, 1Y) 

* 

131 

I DN- IN- 1 XL 

1 

1 35 

I DY  - T Y - 1 YL 

i 

ISO 

DX - I ON 

1 37 

dy  - 1.  dy 

( 

1 3 2 

DU'-PX.I  DX  i DYTDY 

130 

CALL  GENT f -ALT ) 

3 T 0 

CALL  GPUTi  1 PI,,  53,  IPX.  IDS’) 

! 

171 

IF ( D 3 . LT . ICC . ) GOTO  510 

i nr-; 

JGO  1 1 
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C DP  All  VECTOR 
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i 75 
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C CHECK  EUP  AUTAr.ntlC  CLOSING 
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1 MI  ME 1 1 VORTXII  FIN  IVCG)  0012  HOURS 

1 C 

2 C 

3 SUBROUTINE  TRACKS  I IX, IY ) 

‘1  COMMON  /ATT / 1 A T T ( 1 2 ) 

C FIND  TRACKBALL  POSITION 
C RESTRICTIONS: 

C CYCLE  TIMER  ALREADY  TIJRMED  ON 
C CAUTION: 

C ALL  OTHER  INTERRUPTS  ARE  IGNORED  EXCEPT  THOSE  FROM  KEYBOARD , 
C WHICH  CAUSE  IMMEDIATE  RETURN 

C IF  KEYBOARD  INTERRUPT  OCCURRED,  IX  AND  IY  ARE  UNCHANGED 

C 

300  I ATT  C 1 ) =0 

CALL  G5TT ( 0 , 0 ) 

310  CONTINUE 

IF  ( I ATT ( 1 ) . EQ . 0 ) GO  TO  310 
IF  ( IATTC 1 ) .EQ . 36)  RETURN 
IF  ( IATTC.  1)  , NE  . 30)  GO  TO  300 
CALL  GDEVC 1 , IX, IY) 

I X = I X/5+500 
IY= I Y/5+500 
RETURN 
END 

ERRORS  COMPILATION  COMPLETE 
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IS 
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16 
1? 
IS 
19 
£0 
61 
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Vi1 

£4 

£5 

£6 
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£S 

£9 

30 

31 
33 

33 

34 

35 

36 
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MI  MIL  1 1 VORTX.T  I FTN  IV  (O 


001  a HOURS 


SUBROUTINE  SAMPLE 

COMMON  XCOMUM/NC’VI-TR  , NMOVl.YI  EC  ) . J FLOG ! £0) 

COMMON  /M I ME  2 'NCNTIJK  . PRO  PC  (51.  NR  I PC  C 5 . 3 1 , NJ  XV  ( 5 . 3 
1 I XM I N ( £ ) . I NMAX (£1.1 YMIN ( 5 > . I YNAX ( £ ) 

common  /son  IS'  2 . i oo . 3 3 , hi  ( 5 , ?.  1 

COMMON  /ATT  ' I ATT ( PM 
COMM  IN  /DISK  • IF-TBC  13) 

DIMENSION  INY(SOO) 

URITE ( 5, 1313) 

1313  FORMAT ( 'ENTERED  SAMPLE  ' 1 
CALL  GBEGCSO.C.O) 

I ELM  ^6 
C 

C SET  UP  NO.  OF  SAMPLES  IN  EACH  ANNULUS 
C 

NCNM1  - NCNTLlR-l 
ISU m-0 

DO  10  1=1. MCNM1 

MI  ( I . 1 1 * IPO  . Kt PROECC  I ) - f’ROBCC  IN  ) )+0  . 5 
I SUM  ■ ISUM+NI  ( I . 1.) 

10  CONTINUE 

NKNCNTUR,  1 )=1C0. 1 TRODC ( MCNTUP ) I 0 . S 
1 SUM  - I SUM  + N I ( NCMTL'R  , 1 ) 

CALK.  C5HLT 

WRITE  (5  , £363)  MCNTUR  , I SUM  , (N1  1 . 1 ) . I " 1 , NCNTUR ) 
£363  FORMAT C 1£I JO) 

C 

C CHECK.  AND  MODIFY 
C 

N I ( 1 , 1 ) rNI  C 1.1)  •■irilM  + lOO 
DO  £0  1 = 1.  NCNTtJP 
N I ( 1 ,£) -MI t I . 1 ) 

£0  CONTINUE 
C 

C SAMPLE 
C 


NRPATH, NIPATH. 


i 


! 


37  DO  300  IF -1.3 

7'S  PX I IX MAX  ( H'  ) - IXMIN  ( IP  ) 

39  X I “ IXMIN (IP) 

4 0 D Y I ••  I YMAN  C 1 E ) - IS’Ml  N '"IF) 

4 1 Y I - I S’M IN ( I K ) 


...  IlL^iiLl iaikUlfe tlttiiiifeliAia*  •!»  HU iuiil'W. 


runt  1 1 


vortni  r 


FTN  I V ( G > 


0012  HOURS 


PAGE 


G9 


VO 


300 


y vi  3 


74 

r?tr 


'6 


,•  o 

0 

/WEO 

/piem 

/FOR 


PROPS 
. 1 4 
6 

. M , H , 


GO  TO  100 
CONTINUE 
CALL  INTRPT 
CALL  TNTRFT 
IF  t T ATT ( 1 ) , NE 
I !■'  f IATTuT  .i  . NE 
NOV FTP  - 0 
NMOVLV ( 1 ) ' 4 
RETURN 
END 

COMPILATION  COMPLETE 


36)  GO  T 
0)  GO  TO 


? 093 
90S 
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t ‘Tl 

S 


■) 
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MI ME  1 1 


VOKTNJ I 


I V ( G > 


0013  H0U?5 


SUBROUTINE  N I M r I I 

COMMON  .'Mini£2/rsCNTUR,PR0BC(5>  .NRIPCrS.3)  .NINVC5.3)  MRPATH  . N I PATH 

ixMiruRi . inmance),  iynini  2)  , iymancp) 

COMMON  /CONTUK'-’MXV  . IXY  (SCO  . ICCLORCfP  . LSI . ICIIRSR,  I ALT.  I MSG 
COMMON  /COMLtN  -'NOVFTR  , NMoVLV  ( 20  ) . I FLAG  i 50  ) 

C-OMNOM  'DIMK/IFCLU  131 
COMMON  /ATT/ I AT TC 15) 

COMMON 
COMMON 


/SAM  ' 1 5 C 2 , 1 00 , 3 ) . NI I 5 . - > 
'MISS  ‘NFS 


10 

EQUIVALENCE  (I Cl 

1 1 

I F ( I FLAG ( 1 ) . EG . 

12 

I FLAG  C 1 ) = 1 

13 

URI TECS. 4040) 

14 

4040 

FORMAT  ENTERS’ 

IS 

IFCBC4 ) - NRPATH 

16 

NXY* NT  PATH 

17 

RFAPUS)  (I  NY (I 

IS 

L.PATH--  10*  CNNY-C5 

10 

IXAO=IXY( 1 ) 

20 

I VAO " IXYC2) 

21 

I X L> 0 1 IXYCNXY-5) 

— » 

4-4  U 

I YBO * IXY (NXY- 4 ’ 

£3 

WRITE.  (S.GS)  NXV 

24 

66 

FORMAT  Cl OI 1 2) 

25 

1 PTCUR  = 1 

26 

INCUR-’  IXYI2TIFT' 

iT.  . 

IYCUR=  I XV  (2.*  I PT 

2S 

CALL  GBEG (21 , IN 

29 

CALL  GPUT (6,1 CO 

30 

CALL.  GPUT  (7  ,160 

31 

C DR  A’ 

■!  CURSOR  CIRLCL5 

32 

1 0 

CALL.  I riTRPT 

*0 

v_-  -J 

IF (IATT(l), ME . 3 

34 

IF ( I ATT ( 3 ) , EG . 3 

33 

I PTCUR = I PTCUR + 1 

3 '3 

INCUR--' IXYC  2TIPT 

37 

lYCUR^IXVCPTlPT 

3S 

CALL  GPUT ( 1,1 00 

39 

CALL  GPLITi2.H0 

40 

GO  TO  10 

41 

C COMPUTE  ROTATION  AM 

42 

20 

DY=IXYC4)-IXV(2 

4 3 

DX  = IXY ( 3 ) - 1 XY  C 1 
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A ebss  of  density  estimates  using  a superposition  of  kernels  sshere  the  kernel  parameter  can 
depend  on  (he  nearest  neighbor  distances  is  studied  by  the  use  of  simulated  data.  Their 
performance  using  several  measures  of  error  is  superior  to  tint  of  the  usual  I’ar-ett  estimators. 
A tentative  volution  is  given  to  the  problem  of  calibrating  the  kernel  peakedness  « lien  faced 
with  a finite  sample  set. 
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Density  estimation 
Kernel  density  estimation 

I.  INTRODUCTION  AND  SUMMARY 

Given  points  X|,  •••,  x„  selected  independently 
from  some  unknown  underlying  density  /(x)  in  A/- 
dimension, ’ll  Euclidean  space,  the  problem  is  to  esti- 
mate /(x).  To  date,  the  most  effective  general  method 
is  the  Parzen  approach:  select  a kerne!  function  A(x) 
£:  0,  with 


/ 


A(x)  i/x  -•  1 


(1) 


Usually  A(x)  satisfies  some  additional  conditions; 
unimodality  with  peak  atx  0,  smoothness,  symme- 
try, finite  first  and  second  moments,  etc.  tn  fact,  in 
actual  practice,  the  most  frequently  used  kernel  is  a 
Gaussian  density. 

Having  selected  a kernel,  then  the  estimate  is  given 
as 

As  //  increases  the  shape  factor  a can  be  decreased 
giving  greater  resolution  for  larger  sample  sizes.  The 
asymptotic  mean  stiuare  consistency  of  these  esti- 
mates is  well  known  [7],  and  under  smoothness  con- 
ditions on  /(x)  asy  mplolic  rates  of  convergence  of  Ihe 
mean  squared  error  can  be  derived. 
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However,  in  terms  of  practicalities,  the  situation  is 
far  from  satisfactory. 

First:  It  is  obvious  that  a Parzen  method  of  estima- 
tion cannot  respond  appropriately  to  variations  in 
the  magnitude  of  /(x).  For  instance,  if  there  is  a 
region  of  low  /(x)  containing,  say,  onji’, one  sample 
point  Xu,  then  the  estimate  will  have  a peak  at  x - X» 
a nd  be  too  low  over  the  rest  of  the  region.  In  regions 
where  f(xl  is  large,  the  sample  points  are  more 
densely  packed  together,  and  the  Parzen  estimate  will 
tend  to  spread  out  the  hieh  density  region.  Thus,  the 
problem  is  that  the  peakedness  of  the  kerne!  is  not 
data-responsive. 

Second:  None  or  the  asymptotic  results  give  any 
generally  helpful  leads  on  how  the  shape  factor  rr 
should  be  selected  to  give  the  “best”  estimate  of 
unknown  density.  The  computed  rates  of  con- 
vergence depend  critically  on  /(x)  and  its  derivatives. 
Even  if  one  tried  to  vary  a and  got  a number  of 
different  estimates,  the  question  remains:  which  one 
is  "best”? 

Jn  this  paper,  solutions  are  proposed  to  both  of 
these  problems. 

First:  To  make  t he  sharpness  of  the  kernel  data- 
responsive,  we  use  the  class  of  estimates 


/(*)  - “ £ («*4 

//  J - 1 


/.A  ' 


where  dtk  is  the  distance  from  the  point  x,  to  its  Ath 
nearest  neighbor,  and  «*  is  a constant  multiplicative 
factor,  The  intuitive  concept  is  clear:  In  low  density 
regions,  r/,.*  will  he  large  and  the  kernel  w ill  he  spread 
out.  In  high  density  regions,  (lie  converse  will  occur. 

Sii  und:  To  select  optimizing  values  of  A and  <■•.  a 
P'Mjdney,  of-lit  siatNtic  $ lor  muliivuiiatc  densities 
proposed  in  jl]  is  used  in  a procedure  that  searches 
for  the  variable  kernel  parameters  that  ruiniini/c*  .**, 
(see  section  3 for  die  definition  of  S). 
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There  is  a large  body  of  published  literature  re- 
garding density  estimation  and  a number  of  good 
surveys  are  available  [4|,  (l)|,  [2|.  The  Ath  nearest 
neighbor  estimator  [5 ] is  the  only  method  that  is 
adaptive  to  local  sample  density.  If  the  distance  from 
a point  x to  its  Alb  nearest  neighbor  is  (/.  then  this 
estimator  is  defined  as 


Ax) 


k/n 

W) 


where  n is  the  total  number  of  samples,  and  ! (</)  is 
the  volume  of  the  ^/-dimensional  sphere  of  radius  d. 
The  drawback  to  this  type  of  estimate  is  that  it  is 
discontinuous.  (Also  its  integral  over  all  space  is  in- 
finite.) The  variable  kernel  approach  offers  a combi- 
nation of  the  desirable  smoothness  properties  of  the 
Pardon-type  estimators  with  the  data-adaptive  char- 
acter of  the  A-nearest  neighbor  approach. 

Furthermore,  the  variable  kernel  method  carries 
very  little  computational  penalty.  The  distance  from 
a given  point  to  the  Ath  nearest  point  is  computed 
only  once  and  stored  for  all  the  calibration  runs.  An 
algorithm  constructed  by  Friedman,  et  al.  [31  reduces 
the  finding  of  all  Ath  nearest  neighbors  to  n log/i  time 
instead  of  //*. 

'I  he  analytics  of  the  situation  are  a bit  dillieult  to 
handle,  although  asymptotic  consistency  for  ap- 
propriate kernels  is  easily  proved  under  the  condition 
k/n  -•  0.  To  get  a feeling  for  the  finite  sample  situa- 
tion and  also  to  get  some  measure  of  assurance  that 
Tnir  proposed  “solutions"  had  some  value,  "c  ran 
some  extensive  simulations  on  two  underlying  data 
bases;  the  first  was  400  points  selected  from  a bivari- 
ate normal  distribution,  the  second  was  400  points 
selected  from  a bi modal  distribution  consisting  of  a 
superposition  of  two  bivariate  normal;;,  3/4  of  the 
bivariate  normal  used  in  generating  the  firs;  data  set 
plus  1/4  of  a normal  with  a much  sharper  peak. 

Three  measures  of  error  were  computed:  define  the 
sample  mean  and  variance  of  /(x)  b> 


A/ 


I 

/i 


E fa) 


* / 


£ (/(*/)  - A,)’ 


The  error  measures  were: 


I I'l'Sl.i  1'cri'cnl  of  1'initunc  Sot  E.\f>lainrii 

I’VN  I r 1 £ (Axy)  /(>,))'  X 100 

*•/  II  I 

IMM.I  \hvn  Ahsntutc  / rror.  Eernnt 

MAI;  £ l/(X/)  /(M  X UK) 

Ilf1/  I 

(M/’El  .)/«•<//;  I'vnxnt  Error 


M IT 


I 

// 


E 


:J'M  N mu 

A*Z> 


A large  mimbcr  of  runs  were  carried  out  with  the 
two  data  bases  to 

O For  each  measure  of  error  find  the  “best"  Pai- 
/cn  estimator  and  the  “best"  variable  kernel  estima- 
tor. using  :i  symmetric  CJaussian  kernel  (i.e.,  find 
those  values  of  the  pirameters  ■*.  A,  o*  that  minimiis 
the  given  measure  of  error). 

O Compare  the  performances  of  the  two  types  of 
estimators. 

O To  sec  whether  the  proposed  search  procedure 
could  accurately  locate  the  “best  fitting"  parameter 
values. 

Our  conclusions  are: 

/.  In  all  case..  the  best  variable  kernel  estimator 
was  superior  to  the  best  Par/cn  estimate.  The  best 
Parzen  estimator,  in  both  data  sets,  had  about  twice 
as  much  mean  percent  error  (M  PH)  and  percent  of 
variance  not  explained  (PVNK).  and  about  more 
mean  absolute  error  than  the  best  variable  kernel 
estimator. 

ii.  Tlic  S minimization  search  procedure  was  suc- 
cessful in  locating  the  region  of  parameter  values 
where  the  variable  kernel  estimates  gave  approxi- 
mately best  fits  to  the  actual  density. 

The  best  values  of  a for  die  Par/cn  estimates  de- 
pended on  which  measure  of  error  was  used  much 
more  than  the  variable  kernel  method  and  hence 
would  be  much  more  dillieult  to  use  in  practice  (when 
/ is  unknown).  The  S minimization  procedure  applied 
to  the  Parzen  estimates  produced  values  of  a that 
were  larger  than  most  of  the  “best”  values  and  could 
not  be  c.i’led  successful  in  this  context. 

Oaring  the  comse  of  the  study  , a number  of  inter- 
esting and  useful  properties  of  variable  kernel  den- 
sities were  uncovered.  Recalling  that  the  total  sample 
size  is  4,'0.  nearest  neighbor  distance*  that  produced 
the  best  fas  v- ore  surprisingly  large,  ranging  from  40 
i:i  d:;:.r  set  !!  to  UK)  in  data  set  I.  (actually  the  tit  was 
sti'1  improving  at  A ~ 100).  ltut  good  fits  cm  be 
produced  over  a very  wide  range  of  values  of  A.  ns 
long  as  n*  satisfies  the  nppio.vim.ite  relation 


where  </*  is  the  mean  of  the  Ath  nearest  neighbor 
distances  and  r(</»)  is  their  stamlaul  deviation  Out 
tentative  conclusion  is  therefore  that  actually  one 
needs  to  find  only  the  single  paiameier  value 
(r'n(r/i.)’/«(iA)]  to  calibrate  the  vaiiahlc  kernel  csli 
males.  In  our  simulation  this  constant  wa  • usually 
ahotil  3 4 times  larger  111. in  the  (vest  values  of  >•  loi 
the  cot  responding  P.if/cn  estimate. 

The  conclusion  that  the  mean  percent  crr.u  t-. 
markedly  different  between  the  ivvo  types  of  c'iiina 
tors  has  impoil.mi  implications  hu  chissiliv.iiioi’.  I he 
method  giving,  the  minimum  expected  mis 
classification  pich.ihjluy  is  based  on  comp.iiiiig  the 
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densities  of  the  different  classes.  One  common  and 
clVcetivc  method  of  getting  “good"  classification 
boundaries  has  been  to  estimate  the  class  densities 
using  a set  of  points  that  base  already  been  classified, 
and  to  compare  the  density  estimates  to  make  the- 
dassilication  decision.  If  this  is  the  intended  appli- 
cation, then  the  mean  percent  error  may  be  the  most 
significant  error  measure,  since  it  is  the  ratio  of  the 
two  estimates  that  determines  the  classification.  In 
this  perspective  the  variable  kernel  estimates  are  de- 
cidedly superior  to  the  J’ar/cn  estimates. 

An  important  consideration  is  the  variability  of  the 
underlying  density.  If  it  is  more  or  less  uniformly 
smooth  (as  in  the  first  data  base),  the  adaptive  capa- 
bility of  the  variable  kernel  method  docs  not  help  us 
much  as  in  situations  where  the  density  is  more  vari- 
able, i.o.,  has  a number  of  peaks  of  dilVerent  sharp- 
ness (as  in  the  second  data  base). 

The  body  of  the  paper  is  laid  out  as  follows:  Sec- 
tion 2 describes  the  simulations  in  more  detail  and 
includes  some  tabular  and  graphical  summaries  of 
the  results,  Section  3 contains  a brief  description  of 
the  goodness-of-lit  statistic  together  with  tabular  and 
graphical  summaries  of  its  performance.  Section  4 
summarizes  the  behavior  of  the  estimates,  relates  the 
selection  of  k and  n to  the  inierpoint  distance  distri- 
bution, and  gives  a description  of  some  early  and 
unsuccessful  efforts  at  variable  kernel  estimates. 

The  vaiiable  kernel  method  has  been  described  in 
shoit  course  notes  on  pattern  recognition  prepared 
by  one  of  the  authors  and  dating  hack  to  1473.  Part 
of  the  work  in  this  present  study  was  presented  in  the 


Conference  on  the  Interface  between  Computer  Sci- 
ence and  Statist, cs  on  February  14,  1975  [f»].  In  June, 
1475  we  learned  that  T.  J.  Wagner  had  submitted  a 
paper  to  the  IFHF  Trans.  Information  Theory  which 
is  also  concerned  with  the  variable  kernel  estimates. 
Mis  paper  [S J establishes  conditions  for  asymptotic 
consistency,  particularly  in  one  dimension. 


7.  Ull-SIMLU  ATION  AND  ITS  RI-.SUl.fS 


The  two  data  sets  mentioned  in  the  introduction 
were  generated  as  follows: 

Set  I.  400  points  selected  independently  from  the 
density  /,  a bivariate  norma!  with  mean  in  (0,  0) 
and  unit  covariance  matrix. 

Set  II:  400  points  selected  independently  from  the 
density  .c,  where 

g “ .75/  b -35/, 


where / is  as  above,  and  /,  is  normal  with  parameters 


m * (3,  3). 


1/4 

0 


where  1'  is  the  covariance  matrix. 


° ) 
1/9/’ 


The  kerne!  for  both  types  of  estimators  was  a zero 
moan  Insatiate  normal  density  with  unit  covariance 
matrix. 

IIGURF  I is  a graph  of  the  three  error  measures 
ia  data  set  1 as  a function  of  the  shape  parameter  t>  of 
the  I’ar/cn  estimators. 

1TGURF  2 is  a graph  of  the  three  error  measures 
for  data  set  I,  where  we  selected  k - 100  and  varied 
the  multiplicative  parameter  <v, 

FIGURUS  3 and  4 are  the  analogous  graphs  for 
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Oulu  set  II,  where  we  have  used  A ~ 40  in  the  variable 
kernel  graph. 

In  all  eases,  we  ran  the  simulations  until  the  min- 
imal values  of  the  three  measures  of  error  were  found, 
both  for  the  Par/en  anil  variable  kernel  estimators. 
For  the  variable  kernel  estimators  we  ran  the  simula- 
tions for  k -■  10,  20,  .TO.  40,  50,  and  60  in  both  data 
sets,  and  for  k « 70.  SO,  90,  100  in  data  set  1.  Table  1 
below  summarizes  the  comparison  between  the  meth- 
ods. 

To  illustrate  the  resulting  lits  more  visually,  wo 
plotted  T dimensional  graphs  of  the  best  estimates. 
For  data  set  1,  we  used  a - .35  for  the  Par/en  estima- 
tor and  A :-  60,  o •-  ,6  for  the  variable  kernel  estima- 
tor. In  data  set  ?,  the  choice  of  an  “optimal"  <■  was 
more  problematical.  We  settled  on  ,275  as  a reason- 
able compromise.  For  the  variable  kernel  we  took  A 

40,  o ■ .5.  Tito  results  are  shown  in  figures  5,  6,  7, 
and  8 (see  end). 

Fortunately,  the  variable  kernel  results  were  sur- 
prisingly insensitive  to  the  choice  of  A . fable  2 below 
gives  the  minimum  values  of  the  measures  of  error  for 


the  different  values  of  A.  Note  that  in  both  examples, 
values  of  A over  almost  the  entire  range  give  quite 
comparable  error  measurements. 

As  A varies  the  fit  behaves  slightly  differently  for 
the  two  data  sets.  For  the  smooth  density  of  the  fust 
example,  the  error  measures  are  still  decreasing  at  A 
- 100  and  we  would  probably  have  gotten  slightly 
better  results  by  going  on  to  larger  A,  Foi  the  second 
density  the  error  measures  decrease  up  to  A - 40  and 
then  increase  at  A « 50  and  60,  (except  for  the  MIH  ). 

While  the  best  fit  for  each  value  of  A in  a wide 
range  has  about  the  same  error  measures,  the  values 
of  the  multiplier  o at  which  the  minimum  errors 
occur  vary  considerably  but  systematically  as  A in- 
creases, We  will  cxplote  this  further  in  Section  4. 

3.  Tin:  liOODNI  SS  OI'-t  U t'Klll  RION 

Since,  in  practice,  the  under!)  iug  /(x)  is  not  know  n. 
the  various  error  measures  cannot  be  computed.  1 his 
brings  us  to  the  second  question  posed  in  the  in 
troduo.ioti:  How  then  do  we  go  about  selecting  « ot 
•a  and  A.  (Although  we  surmise  that  in  actuality  we 


T MU  t I- \fcthoJ% 


MinF  j i 1 too n 
Percent  t rroe 

Minir'iini  Percent  of 
Variative  Not 
Explained 

Mini  nnn  IN' an 
Absolute  Irror, 
Percent 

far/oii, 
r.ita  Set  1 

19.0 

to 

11.  b 

Variable 
fata  Set  1 

t 

1 0 , It 

3,6 

r..P 

Par. 'ill, 
fata  Set  it 

r ■"  ■ ' 

34.7 

13.1 

'•1 . 5 

Variable  kt  i tvl , 
fata  Set  II  , 

?;  b 

t>,.’ 

10. b 

Tie  HNOMt  IKK  y.'\  vot.  tv,  no  mat  iv 


need  to  estimate  only  the  optimal  single  parameter 
value  X = t(d*)7/0(d*)  in  the  variable  kernel  esti- 

mates.) 

In  [2]  a goodness-of-fit  criterion  for  a set  of  sam- 
ples to  a proposed  density  /(x)  was  developed  based 
on  the  fact  that  if  /(x)  is  the  true  density,  then  the 
variables 

Wj  = Jm  1 

where  V{r)  is  the  volume  of  an  M-dimensional  sphere 
of  radius  a,  (5'(a)  H Mnrv/l'(M/2  I-  I)),  have  a 
univariate  distribution  that  is  approximately  uni- 
form. Thus,  the  test  statistic  for  an  estimate  ;(x)  is 
based  on  the  variables 


One  question  of  great  interest  to  us  in  this  study 
was  whether  we  could  select  “good”  values  of  a or  k 
and  a„  searching  for  a minimum  in  £.  The  results 
were  affirmative  (with  one  exception  wc  will  discuss 
later).  Naturally,  different  error  measures  were  gener- 
ally minimized  at  different  values  of  the  parameters. 
In  Table  3 we  list,  for  every  value  of  k used,  the  value 
of  a that  minimizes  each  error  measure  and  the  value 
of  a that  minimizes  S for  that  value  oT  k. 

For  the  unimodal  case  the  absolute  minimum  of  S 
occurs  at  k - 100,  ct  = 5.  At  this  point  we  have 


if,  i ...  „ Mean  Percent  Error  = 12.5  (10.8) 

J M*  •’  ’ ’ Percent  of  Variance  Unexplained 

Let  u’,,.,  <.■••<,  w,,,,  be  the  ordered  permutation  of  — 4.2  ( 3.6) 

the  Wj.  Then  the  test  statistic  $ is  defined  as  Mean  Absolute  Error,  Percent  “ 8.8  ( 8.0). 
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The  figures  in  parentheses  arc  the  minimum*  of  the 
corresponding  measures  of  error  over  all  ranges  and 
do  not  occur  at  a common  value  of  A and  o. 

In  the  himodal  case,  the  minimum  of  7?  occurred  in 
the  original  runs  at  A 60,  n - ,4.  The  values  at  this 
point  wore  farily  close  to  the  minimum*,  i.e., 

Mean  Percent  Error  - 22.8  (22.5) 
Percent  of  Vaiiancc  Unexplained 

“ 10.7  ( 6.2) 

Mean  Absolute  Error,  Percent  ---  18.8  (16.5). 

For  the  Parpen  Estimator  with  data  set  1,  the  min- 
imising v allies  of  it  for  the  three  error  measures  abo\  e 
were  .40,  .35  and  .30  respectively.  The  minimum 


value  of  3v  occurred  at  .60.  Tor  data  set  U,  the  min- 
iimims  occurred  at  .400,  .175,  .225  and  the  minimum 
of  S at  .375.  For  Par/en  estimators  S indicates  “op- 
timal" values  of  o considerably  higher  than  the  values 
of  o that  minimize  the  PVNE  and  ihe  MAE.  There  is 
also  less  consistency  between  the  error  measures  as  to 
tlvc  location  of  the  respective  minimizing  a.  The  « 
that  minimizes  the  mean  percent  error  is  the  highest, 
and  in  the  bivariate  ease,  considerably  higher  than 
the  other  two  minimizing  values  of  c.  Probably  this 
latter  fact  is  due  to  the  behavior  of  the  Par/en  esti- 
mate'. at  small  values  of  /(x). 

In  both  data  .sets,  the  S estimate  of  e gives  a value 
of  mean  percent  error  close  to  the  minimum  attain- 
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TABLE  2— Minimum  values  of  the  measures  of  error  for  the  different  ui, 


Data  Sat  1 


k - 

10 

20 

30 

40 

50 

60 

70 

Minimum  Moan 
Percent  Error 

12.9 

12.8 

12.2 

12.1 

11.7 

11.61 

i 

11. 

! 

Minimum  Percent 
of  Variance  Not 
Explained 

6.8 

6.3 

5.9 

J 

4.8 

4. 

Minimum  Mean 
Absolute  Error, 
Percent 

11.7 

11.2 

10.7 

10.3 

■ 

9.3 

9. 

Data  Set  II 


k - ' 

10 

30 

40 

Minimum  Mean  Percent 
Error 

24.5 

23.8 

23.0 

22.6 

Minimum  Percent  of 
Variance  Mot 

Explained 

1 

7.6 

6.8 

Minimum  Mean 

Absolute  Error, 
Percent 

19.1 

17.9 

■ 

16.5 

able  for  the  data  set.  This  is  consistently  true  for  the 
variable  kernel  estimates  also.  For  each  value  of  A, 
the  $ minimising  value  of  «*  has  a mean  percent  error 
close  to  the  minimum  possible  for  that  value  of  A. 

4.  MEAN  INTERHOINT  DISTANCE  AND 
THE  CHOICE  OF  a 

In  our  various  explorations  of  the  variable  kerne! 
estimates,  we  made  the  empirical  discovery  that  for 
both  data  sets,  over  the  range  of  k investigated. 

«/,((/*  )5 

— t—  = constant 

°{a>) 

where  <lk  and  <*(dk)  are  the  mean  and  standard  devia- 
tion of  the  Ath  nearest  neighbor  distances  fur  the  data 
set,  and  a*  is  the  “optimal”  a for  that  value  of  A.  To 
illustrate  this,  we  use  as  the  “optimal”  value  of  oA, 
the  average  of  the  first  three  minimizing  values  given 
in  Tabic  3.  Table  4 gives  the  values  of  «*(<f*)V<7(d*). 

The  constant  decreases  about  40%  between  the  two 
data  seis.  A similar  decrease  occurs  for  those  values 
of  a in  the  Parzcn  Estimates  which  minimize  the 
Mean  Absolute  Error  % and  the  Percent  of  Variance 
Not  Explained.  It  seems  clear  that  the  increase  in 
optimal  kcrnal  sharpness  occurs  m order  to  deal  with 
the  increased  variability  in  data  set  § 2 . 

At  the  beginning  of  this  study,  we  used  distances  to 
the  closest  neighbor,  next  closest  neighbor,  etc.,  up  to 
the  fifth  nearest  neighbor.  The  results  were  dis- 
astrous. Examining  the  errors,  they  came  mainly 
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from  a few  points  that  were  too  close  together.  We 
tried  a number  of  things: 

i.  Selecting  a lower  bound  D for  the  interpoint 
distances  and  using 

d' “ max  (0,  r/,.«) 

in  the  kernel  estimate  of  dj,k.  1)  was  selected  as  a 
percentile  (usually  cither  the  5th  or  10th)  of  the  dj,k, 
j = !,•••,  400. 

it.  Using  a weighted  average  of  the  first  k nearest 
neighbor  distances. 

in  Selecting  a multiplicative  constant  «*  and  using 
o kcIj.*.  or 

None  of  these  helped  very  much  as  long  as  we  kept 
working  with  k small.  The  averaging  in  (ii)  was  no 
help,  l ater  we  made  a theoretical  computation  in 
order  to  find  values  with 

* 

oj  ^ 0,  i — , k,  ^ «/  ” ' I 

1 

and  such  that  the  variance  of 

h 

^ 1 otfdj.i 

i 

is  a minimum.  Assuming  that  the  density  was  “locally 
constant”  so  that  the  distribution  of  points  is  “locally 
Poisson,"  the  answer  is 

=nA  , - 0,  a*  = 1 

This  result  gave  us  some  insight  into  the  failure  of  the 
averaging  process. 


VARIABLE  KERNAl  ESTIMATES  OF  MULTIVARiAfE  DENSITIES 
TARI.E  3—  Minimizing  I'ulms  of  or,. 


Mean  Percent 


Percent  of 
Variance 


10 

20 

1.4 

1.0 

1.8 

1.2 

1.5 
or 

1.6 

1.0 

1.7 

1.2 

40 

60 

0.7 

0.6 

0.8 

0.7 

0.7 

0.7 

0.8  1 

0.7 

0.4  0.4 


DATA  SET  II 


Mean  Percent  Error 


Percent  of  Variance 
Unexplained 


Mean  absolute  Error 
Percent 


20 

30 

0.9 

0.7 

40 

50 

0.6 

0.5 

0.4 

0.3 

0.4 

0.3 

0.5 

0.5 

In  (m)  we  found  that  trying  to  get  more  smoothing 
by  increasing  «»,  led  to  serious  underestimates  of  the 
peaks  of  the  densities. 

Nothing  really  helped  until  we  started  exploring 
the  larger  values  of  A:  and  found  that  (iii)  w orked  well 
when  A was  large  enough. 

In  terms  of  what  has  been  empirically  learned  in 
this  study,  we  tentatively  propose  the  following 
method  for  calibrating  t.  variable  kernel  density  esti- 
mate. 

Step  l Pick  an  initial  k equal  to  someJYaclion  of  the 
sample  sice,  say  10%,  or  by  plotting  dk  versus  A and 


taking  a value  of  k past  the  knee  of  the  curve  (see 
figure  9). 

Stcp  2.  Do  a search  for  the  value  of  «*  that  min- 
imizes 

Step  d.  Using  the  minimizing  value  compute 

\ = ***(</»  )* 

* ~ 

Step  4.  Vary  k in  both  directions,  selecting  uH  so  as  to 
hold  the  above  ratio  constant  and  search  for  a k value 
that  minimizes  5. 

Note  that  Step  3 may  be  dimension  dependent. 


TABU-.  •?— «,((A.)Ve(rf/.) 

k = 10  20  | 30 

40  | 50 

60 

70 

80 

90 

« 

Data  Set  rl  1.3  1.3  l.b 

\ 

1.5  1.5 

1.5 

1.5 

1.5 

l.b 

Data  Set  a?  .83  .80  .84 

.85  .79 

.84 

- 

- 
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FIGURE  9 — The  Mean  lntcrpoinl  Distance  <7,  versus  k 
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APPENDIX  D — SKETCH  MODEL  RESEARCH 


Integrated  Sciences  Corporation  has  developed  and  researched  a 
military  decision  aid  called  the  "Sketch  Model"  procedure.  This  procedure 
allows  a human  operator  to  communicate  to  a computer  his  subjective  esti- 
mate of  the  form  of  any  functional  relationship  that  is  continuous  in  at. 
least  one  dimension.  This  communication  is  performed  by  the  operator  using 
an  input  device  to  electronically  "sketch"  the  function  on  a computer 
graphics  display. 

The  Sketch  Model  approach  to  subjective  estimation  is  hypothesized 
to  have  certain  advantages  over  comparable  decision  aiding  techniques,  such 
as  the  scalar-value  representation  of  subjective  judgments.  These  advan- 
tages include  comprehensiveness  of  ec/ /motion;  ease,  speed,  and  accuracy 
of  estimation  and  of  updating;  the  ability  to  consider  qualitative  data; 
and  the  capability  of  allowing  Bayesian  estimation  without  explicit  a priori 
da  t a . 


A number  of  these  hypothesized  advantages  have  been  experimentally 
validated  by  research  carried  out  at  ISC's  Simulation  and  Display  Facility 
(SDF).  This  multi-year  research  program  has  consisted  of  four  phases: 

1.  Evaluation  of  the  Ability  of  Humans  to  Use  the  Sketch 
Model  Technique  to  Estimate  a Bivariate  Gaussian  Density  Function 
from  Sampled  Data. 

2.  Evaluation  of  the  Usefulness  of  Three  Control  Devices  in 
Generating  Contours  Required  for  Sketch  Models. 

3.  Evaluation  of  the  Ability  of  Humans  to  Use  the  Sketch 
Model  Technique  to  Approximate  a Multi-Modal  Tactical  Fuiv  i ion 
Based  on  Qualitative  and  Quantitative  Information, 

J),  Evaluation  of  the  Ability  to  Use  the*  Sketch  Models  Pro- 
duced by  Humans  to  Drive  an  Operator  Aided  Optimization  Procedure 
for  Tactical  Decision  Making. 
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The  Phase  I project  had  a variety  of  purposes  but  was  primarily 
aimed  at  determining  the  accuracy  of  humans'  attempts  to  use  the  Sketch 
Model  procedure  to  estimate  a Divariate  Gaussian  Density  Function  (BGDF) . 

A baseline  comparison  was  provided  by  carrying  out  a Maximum  Likelihood 
Estimation  (MLE)  procedure  on  the  same  experimental  stimuli  (data  points 
sampled  from  trial  BGDF's). 

An  experiment  was  conducted  with  the  following  independent  variables 
incorporated  into  the  design: 

• Procedure  (MLE  vs.  human  operated  Sketch  Model) 

• Characteristics  of  true  BGDF  (x,  y",  crx,  a y,  p) 

• Sample  size  of  data  points  used  by  procedure  (5,  10,  100) 

• Subjects  (7  UCLA  undergraduates) 

The  primary  dependent  variable  was  error  from  the  true  parameter  value  of 
the  BGDF.  The  subjects  were  trained  for  ^0  hours  spread  over  four  weeks. 

The  experimental  procedure  consisted  of  presenting  a subject  with  a number 
(5,  10,  or  100)  of  data  points  sampled  from  the  true  BGDF  via  a graphics 
CRT  terminal.  The  subject  was  then  asked  to  develop  his  estimate  of  the 
true  BGDF  via  the  Sketch  Mode!  procedure. 

Using  the  Sketch  Model  procedure  to  develop  a model  of  BGDF  consis- 
ted of  two  steps.  In  the  first  step,  the  subject  used  a light  pen  to  elec- 
tronically "draw"  on  the  CRT  a' family  (five)  of  concentric  symmetric  ellipses 
superimposed  on  the  sampled  data  points.  These  ellipses  represented  the 
subject's  estimate  of  a family  of  iso-probability  contours  of  the  true 
BGDF.  The  second  step  consisted  of  the  subject  using  scalar  judgment  to 
estimate  the  probability  represented  by  each  of  his  drawn  contours.  He  was 
provided  with  a histogram  feedback  of  all  five  probability  values.  The 
five  contours  plus  the  five  probability  values  completed  the  Sketch  Model 
estimate  of  the  BGDF. 

An  adaptation  of  Green's  Theorem  was  used  to  operate  on  the  subjects' 
contours  to  measure  the  wathemat ical  moments  of  the  Sketch  Model.  These 
moments  were  then  used  to  determine  the  Sketch  Model's  estimates  of  para- 
meters (x,  y\  ax,  Oy,  p)  of  the  BGDF.  The  MLE  procedure  was  applied  to 


I 

I 

I 

I 

I 

I 

l 


I 


I 

I 

I 

! 

I 

I 


the  sonu'  sots  of  sampled  data  points  shown  to  tho  subjects  to  dove  lop  com- 
pel inp  estimates  of  the  BfiOr  parameters,  The  error  histograms  were  devel- 
oped for  each  of  the  li  ve  BliDf  paiamotois  for  both  Sketch  Model  and  Ml.l. 
procedures.  These  histograms  were  comp. nod  to  investigate  which  procedure 
was  superior  {ns  measured  by  probability  of  a given  sl.'e  of  estimation 
error)  and,  If  so,  under  what  conditions. 

Visual  Inspection  and  non-parametric  statistical  tests  lead  to  the 
foil  owl ng  cone l ns i ons : 

1,  With  100  sample  points,  MLf  produced  superior  estimation 
performances  over  the  Sketch  Model  approach. 

?.  With  sample  sizes  of  10,  the  two  procedures  were  Insig- 
nificantly different  with  respect  to  estimation  performances. 

3.  With  sample  sices  of  5,  the  Sketch  Model  procedure  was 
superior  to  MLf. 

h.  The  first  three  conclusions  were  true  for  all  five  para- 
meters but  differed  in  degree  from  parameter  to  parameter,  for 
example : 

{a)  The  Sketch  Mode)  appro.u  h was  generally  better  at 
estimating  horizontal  aid  vertical  means  (x,  y“)  because  of 
tho  ability  of  the  humans  to  non  I t near  iy  weight,  the  influence 
of  outliers, 

(t>)  Tire  Ml  F approach  was  generally  hotter  at  estimating 
the  horizontal  and  vertical  standard  deviations  (nx,  "y)* 

(c.)  The  Sketch  Model  procedure  was  vastly  super  ior  at 
estimating  the  correlation  coefficient  (p). 

This  first  research  project  established  beyond  any  doubt  that  tire 
Sketch  Model  procedure  was  a viable  alternative  to  any  military  estimation 
requirement.  This  is  particularly  so  since  the  tirst  experiment  was  a 
straightforward  estimation  task  without  any  opportunity  for  tire  human  sub- 
jects to  take  advantage  of  qualitative  informal  Ion  sources.  Wherever  these 
are  available,  they  will  likely  Improve  the  competitive  edge  of  tho  Sketch 
Model  approach  with  respect  to  completely  automatic  techniques. 
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The  Phase  I!  research  was  aimed  at  evaluating  the  relative  useful- 
ness of  three  control  devices  for  Implementing  the  Sketch  Model  procedure. 
One  way  to  implement  o Sketch  Model  is  for  the  decision  maker  to  "draw" 
the  curve,  line,  or  surface  representing  his  estimate  on  a computer-driven 
graphics  display.  Various  types  of  control  hardware  are  available  to  per- 
form drawing  tasks  in  conjunction  with  an  interactive  graphics  display; 
among  them  are  the  light  pen,  the  track  ball,  and  the  Joy  stick.  The  light 
pen  is  one  of  the  most  commonly  used  devices.  It  consists  of  a hand-held 
fiber-optic  tube  that  can  be  "pointed"  at  a light  source  (e.g.,  cursor)  on 
the  screen  and  used  to  move  the  cursor  to  produce  a line.  The  joy  stick 
and  track  ball  are  both  analog  devices.  The  Joy  stick  resembles  a pilot's 
control  stick.  The  track  hall  consists  of  a recess-mounted  sphere  that  can 
he  rotated  by  the  palm  of  the  hand.  Both  are  equipped  with  potentiometers, 
whose  outputs  are  converted  to  digitized  x-  and  y-values,  so  that  the 
cursor  on  the  screen  moves  in  direct  proportion  to  the  movement  of  the 
device. 


The  Phase  II  project  was  undertaken  to  evaluate  the  light  pen, 
track  ball,  and  joy  stick  for  types  of  drawing  tasks  representative  of 
Sketch  Model  applications.  Accordingly,  the  primary  experimental  null 
hypothesis  was  that  there  is  no  significant  difference  among  devices.  The 
experimental  procedure  consisted  of  having  the  subjects  use  each  of  the 
three  control  devices  to  draw  as  perfect  a circle  and  as  perfect  an  equi- 
lateral triangle  as  possible, 

A criterion  function  combining  the  relative  importance  of  curved 
(circle  test)  versus  straight  line  (triangle  test)  performance  was  devised. 
A parametric  sensitivity  analysis  was  carried  out  to  investigate  the  depend 
ency  of  the  superiority  of  each  control  device  on  the  relative  importance 
of  curved  versus  straight  lines.  It  was  concluded  that  the  track  ball 
produced  superior  "drawing"  performances  for  all  reasonable  weights  of 
straight  versus  cur,  lines.  Thus,  the  track  ball  was  selected  as  the 
hest  control  devic'  implementing  the  Sketch  Model  procedure  and  was 
used  in  all  later  research. 
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In  the  Phase  I research,  operators  were  shown  sets  of  points  randomly 
sampled  from  known  bivariate  Gaussian  probability  density  functions  and 
asked  to  sketch  (on  the  display)  their  estimates  of  the  iso-probability 
contours  of  the  parent  distribution.  The  study  indicated  that  humans  can 
produce  accurate  (i.e.,  competitive  with  maximum  likelihood  estimation) 

Sketch  Models  of  well-behaved  continuous  functions. 

In  the  real  world,  however,  functional  relationships,  though  they 
may  be  “continuous  in  at  least  one  dimension,"  are  seldom  “well-behaved," 
nor  can  they  always  be  fully  specified  analytically.  The  Phase  III  research 
was  undertaken  to  extend  the  Sketch  Model  concept  in  two  directions.  First, 
the  Sketch  Model  was  applied  to  a tactical  problem  in  which  the  function  to 
be  estimated  was  not  well  behaved.  The  function,  instead,  was  not  only 
multidimensional;  it  was  also  multimodal  and  unsymmetric.  Second,  the 
usefulness  of  decisions  reached  with  the  aid  of  Sketch  Models  was  investi- 
gated. 


The  problem  used  to  study  the  usefulness  of  the  Sketch  Model  as  a 
decision  aid  was  that  of  selecting  the  best  flight  path  for  an  air  strike 
against  an  island,  given  (l)  known  locations  and  suspected  types  of  enemy 
sensors,  and  (2)  predetermined  aircraft  fuel  allotments  and  speed  versus 
fuel  consumption  characteristics.  Enemy  sensor  performance  was  modeled  in 
terms  of  detection  rate  as  a function  of  distance  from  the  sensor.  A 
Sketch  Model  consisted  of  a set  of  the  iso-detection  rate  contours  of  the 
composite  detection  rate  surface  produced  by  four  sensors  at  given  loca- 
tions, but  whose  detection  rate  versus  range  capability  may  be  imperfectly 
known . 


The  goodness  of  a strike  path  was  measured  by  a utility  function 
that  reflected  a trade-off  between  minimizing  the  probability  of  being 
detected  along  the  path  and  maximizing  the  fuel  remaining  at  the  target. 

The  primary  functions  for  specifying  the  best  strike  path  were  modeling 
the  composite  detection  rate  surface  produced  by  the  enemy's  sensors  and 
optimizing  the  strike  path  with  respect  to  the  model.  Four  system  concepts 
were  defined,  representing  different  allocations  of  these  two  functions: 
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(I)  modeling  (without  Sketch  Model  procedure)  and  optimization  both  allo- 
cated to  the  operator;  (?.)  modeling  (via  the  Sketch  Model  procedure)  and 
optimization  (aided  by  the  Sketch  Model)  to  the  operator;  (3)  modeling 
(via  Sketch  Model  procedure)  to  the  operator  and  optimization  (by  a grid- 
oriented  dynamic  programming  routine)  to  the  computer;  and  (U)  both 
modeling  and  optimization  to  the  computer.  This  last  allocation  scheme 
provided  what  amounts  to  "answers"  to  the  problem  set. 

Analyses  of  variance  were  performed  on  strike  path  utility  data  to 
compare  system  concepts.  The  results  were  weakened  by  the  small  number  of 
subjects  (4)  available  to  provide  the  data.  The  conclusions  evaluating 
the  tactical  usefulness  of  the  decision  aid  were  further  weakened  due  to 
the  problem  set  being  too  easy  for  the  subjects.  Within  the  qualifications 
posed  by  the  small  number  of  subjects  and  easy  problem  set,  the  result  of 
the  investigation  of  Sketch  Model  usefulness  was  that  strike  paths  produced 
by  computerized  optimization  operating  on  Sketch  Models  were  significantly 
better  than  scrike  paths  specified  by  subjects  without  the  aid  of  Sketch 
Models, 


The  investigation  of  the  accuracy  with  which  humans  could  produce 
Sketch  Models  of  "messy  functions"  was  not  affected  by  the  easiness  of  the 
problem  set.  Sketch  Model  error  was  measured  in  terms  of  percent  volume 
error  from  the  true  detection  surfaces.  Based  on  an  examination  of  factors 
contributing  to  Sketch  Model  error,  the  findings  relating  to  Sketch  Model 
accuracy  are: 

1,  Humans  can  use  the  present  Sketch  Model  method  to  develop 
accurate  models  of  multimodal,  unsymmet r i c , three-dimensional 
funct i ons . 

2,  Considerable  improvement  over  present  levels  of  accuracy 
can  be  achieved  since  the  major  sources  of  error  can  be  reduced  by 
refining  the  methodology. 

3,  Humans  can  use  the  Sketch  Model  method  to  sign! f icantly 
reduce  the  effects  of  uncertain  information. 
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I'll  .iso  IV  research  is  presently  in  progress  and  I l 1 1 nvest  ly.tto 
tlio  ability  of  automat  ic  opt  i mi  /.it  ion  or  opointot  aided  optimlyot  ion  pro- 
endures  to  list'  Sketch  Models  within  tlu'ir  criterion  functions.  The  Phase 
IV  research  will  also  measure  tho  poi  fornvineo  t mprovomont  refill  t i tty  Trout 
allowing  operators  to  guide,  constrain,  a nil  control  computer  based  optimi- 
zation procedures. 


